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Annual Review Overview 


Purpose - Conduct an assessment of the Project's quality and performance 

Approach - The Project will provide a programmatic review addressing the 
following: 

- Project's Goal and Technical Challenges (TC) and their alignment to NASA and 
ARMD Strategy 

- Project background and alignment with community efforts 

- Key highlights and accomplishments for the Project's technical challenges 

- Project performance of the past year through examination of: 

• Cost/Resource, Schedule, and Technical Management 

• Progress in establishing partnerships/collaborations and their current status 

- Key activities, milestones, and "storm clouds" for FY16 

- Specific Topics; for each of the following describe: 

• Assessment of programmatic rigor and the balance with quality and performance 

• LVC-DE state of the art capability, FY15 work towards enhancements, and future benefit 

• Resources necessary to complete planning for potential additional Project phase 

• FY15 progress towards assessment of UAS full integration and near term next steps 


Outline 


• UAS Integration in the NAS (UAS-NAS) Overview 

- FY15 Summary 
— UAS-NAS Project Background 

• Technical Challenge Performance 

• Non-Technical Challenge Work 

• Project Processes Implementation 

• Project Level Performance & FY16 Look Ahead 

• Review Summary 
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FY15 Summary 


Successful execution of Project Phase 2 Portfolio 

- Executed multiple ground tests, simulations, and flight tests 

- FY15 Annual Performance Indicator (API) 

Balanced rigor with timely and effective project management 

- Incorporating process lessons learned 

Enhanced LVC distributed test environment with augmentation spending 
Integral member of RTCA SC-228 


Delivered research findings and subject matter expertise 
integral to DAA and C2 Preliminary MOPS 
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Annual Performance 
Indicators (APIs) 
UAS-NAS 


AR-15-7: Deliver data, analysis, and 
recommendations based on integrated 
simulations and flight tests to the 
RTCA Special Committee on Minimum 
Operational Performance Standards 
(MOPS) for UAS to support preliminary 
MOPS development. 


* AR-16-8: Deliver data, analysis, and 
recommendations based on integrated 
simulation and flight test series with 
simulated traffic or live vehicles to the 
RTCA Special Committee on MOPS for 
UAS to support development of the 
final MOPS. 


* Revised based on current OCFO submission 
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ARMD Strategic Plan Flow Down to UAS-NAS Project 



AERONAUTICS 
STRATEGIC THRUST 


AERONAUTICS 

OUTCOME 


Thrust 6: Assured Autonomy for Aviation Transformation 

* 

Outcome (2015 - 2025): Initial Autonomy Applications 
with Integration of UAS into the NAS 


UAS-NAS 
Project Goal 


* 


Goal: Provide research findings to reduce technical barriers associated with 
integrating Unmanned Aircraft Systems into the National Airspace System 
utilizing integrated system level tests in a relevant environment 


UAS-NAS 
Research Themes 


UAS-NAS 

Technical 

Challenges 


Research Theme 1: UAS Integration - Airspace 
integration procedures and performance 
standards to enable UAS integration in the air 
transportation system 


Research Theme 2: Test Infrastructure - Test 
infrastructure to enable development and 
validation of airspace integration procedures 

and performance standards 

_ 



TC-C2: TC-SAA: 

Command & Control Sense and Avoid 
Performance Standards Performance Standards 


TC-HSI: 

Human Systems 
Integration 


TC-ITE: 

Integrated 
Test & Evaluation 
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UAS Integration in the NAS 
Organizational Structure 

Host Center Program Office 




PE: Project Engineer, DPMf: Deputy Project Manager for 






External 

Input 


l 


UAS-NAS Project Lifecycle 

I Project Phase 2 





Prior Activities 


Formulation 


Prior 


Project Phase 1- 


FY11/12 


FY13 


P2 Portfolio 
Developed 


41 





♦i 



FY14 


Early investment 
Activities 


I 
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Key Decision 
Point (KDP) 


Sys Analysis: 

ConOps, Community Progress, etc. 


FY1 5 


FY16 


Flight Validated 
Research Findings to 
Inform Federal Aviation * c 
Administration (FAA)^fcj 


Qi 

FY 

17 


P 

R 

O 

J 

E 

C 


Decision Making 

I 


Technology Development to address Technical Challenges 

' ">jj |phase2(P2| 


Phase 1 (PI) 


Initial Modeling 
Simulation, & 
Flight Testing 

1 


B 


Integrated Modeling, Simulation, & 
Flight Testing 



c 

L 

O 

s 

E 

O 

u 

T 


Technical input from Project technical elements, NASA Research Announcements 
(NRA)s, Industry, Academia, Other Government Agencies, Project Annual Reviews 

Timeframe for impact: 2015 - 2025 
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Community Needs Influence on 
Project Phase 2 Portfolio and Technical Challenges 



• Phase 2 Content Decision Process (CDP) included an evaluation of the technical needs 
of the UAS Community 

• Resultant prioritized list, and Community Progress Assessment, of Focus Area Bins 
served as the foundation for Phase 2 Portfolio and Technical Challenges 

• Technical Challenges, Technical Work Packages, and detailed executable Schedule 
Packages were evaluated using a cost/benefit/risk process to determine the final 
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FAA Organizational Relationships 



• The FAA is using several domestic forums, in conjunction with several international 
forums to lay out the pathway for their priorities and investments. 


FAA UAS Center of Excellence 
performs strategic research to 
guide the FAA, while the test 
sites contribute essential inputs 
through UAS testing 


World Radio Conference 
(WRC) and International Civil 
Aviation Organization (ICAO) 
UAS Study Group are 
addressing UAS access from 
an international perspective 


FAA UAS 
COE & 
Test Sites 


Inter- 

national 

Forums 


RTCA 



OSD 

SAA 

SARP 


SC-228 chartered to develop 
Detect and Avoid (DAA) and 
Command and Control (C2) MOPS 


FAA 



UAS 

ExCom 



UAS ARC 


UAS Executive Committee (ExCom): 
Senior gov't steering group focused 
on streamlining public UAS access 


UAS Aviation Rulemaking 
Committee (ARC) Developed civil 
UAS Implementation Plan based on 
the FAA UAS Concept of Operations 
(CONOPs) & Roadmap 


Office of Secretary of Defense (OSD) Sense 
and Avoid (SAA) Science and Research 
Panel (SARP): Chartered by OSD to 
identify SAA Research Gaps 


NASA has a leadership role within many domestic forums 
and participates in the international forums 
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RTCA SC-228 Influence on Project Phase 2 Portfolio 


RTCA SC-228 Terms of Reference (ToR) has defined 
a path forward to develop Minimum Operational 
Performance Standards (MOPS) 

• Phase 1 MOPS are addressed by UAS-NAS 
Current (FY14- FY16) Portfolio 

- Command and Control (C2) Data Link MOPS - 
Performance Standards for the C2 Data Link 
using L-Band Terrestrial and C-Band Terrestrial 
data links 

- Detect and Avoid (DAA) MOPS - Performance 
standards for transitioning of a UAS to and 
from Class A or special use airspace, traversing 
Class D and E, and perhaps Class G airspace 

• SC-228 Deliverables 

- C2 & DAA White Papers (Dec 2013) - 
Assumptions, approach, and core requirements 
for UAS DAA and C2 Equipment 

— C2 & DAA MOPS for Verification and Validation 
(July 2015) - Preliminary MOPS Including 
recommendations for a Verification and 
Validation test program 

- C2 & DAA MOPS (July 2016) - Final MOPS 



RTCA Paper No 109-13PMC-1089 
May 20.2013 

TERMS OF REFERENCE 
RTC A Special C ommittee 228 


RTG\ 


Minimum rerun inance Manual as tot t nmnnnea Alt nun systems 
REQUESTORS: 
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Co-Chair 

Paul 
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BACKGROUND 


Unmanned airaalt have the potential to allow civil, public. commercial, and government 
agencies to increase efficiency save money, enhance safety, and even save lives A broad range 
of applications and services seek to integrate these platforms into non-segregated airspace 

In order to safely integrate these platforms into non-segregated airspace, both a robust Detect and 
Avoid (DAA) and robust and secure Command and Control <C2) Data Link capability need to be 
established 

The Federal Aviation Administration (FAA) established the Unmanned Aircraft Systems 
Integiation Office to miegiate Unmanned An craft Systems (UAS) safely and efficiently into the 
National Airspace System (NAS) 

1 

DAA 

MOPS 


RTCA SC-228 ToR 


FL 600 
MSL 18,000 


CLASS A 
i 


14,500 MSL 


Nontowered 

Airport 


700 AGL 


CLASS E 




CLASS B 


1 



CLASS C 



1200 AGL 


CLASS D 


MSL - mean sea level AGL - above ground level FL - flight level 
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UAS Integration in the NAS Project 

Phase 1 MOPS Value Proposition Flow Diagram 


fa 


NASA UAS-NAS Project Activities 


Key Products 



Resultant Outcomes 


C2 Performance Standards 


Develop 
C2 Prototype 
System 


Conduct C2 Flight Test 
and MS&A 


Data Link 
CNPC Spectrum 
CNPC Security 


LOS 

BLOS 

ATC Interoperability 




Develop C2 
Requirements 


C2 Performance 
Requirements to 
inform C2 MOPS 


fa 


SAA Performance Standards 

4 


Develop SAA 
Performance Testbed 


Develop SAA 
Interoperability Testbed 


Conduct SAA Flight Test 
and MS&A 


Performance Trade-offs CONOPs 
Interoperability Well Clear 

Self Separation Collision Avoidance 
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Develop SAA 
Performance & 
Interoperability 
Requirements 


RTCA 


# 

1 C2 
MOPS 

0 

C2 

Technical 
Standard 
Order (TSO) 


SAA Performance 
Requirements to 
Inform MOPS 


RTCA 


,RTG\ 


i 


Human Systems Integration 


Develop 

Prototype 

GCS 


4 


Conduct Human Factors (HF) Flight 
Test and MS&A 




# 


DAA 

# 

Technical 

RADAR 

Standard 

echnical 

Order (TSO) 

standard 


rder (TSO) 


Contingency Management 
Pilot Response 
Autonomy 


SAA 

C2 

Displays 


Develop HF 


HF Performance 
Requirements to 
inform MOPS and 
HF Guidelines 


% 


Integrated Test & Evaluation 


Develop LVC Test 

r\ 

Conduct 

Infrastructure 


TC Specific Testing 


Conduct IHITL 


O 


Conduct SAA Initial 
Flight Test Scenarios 


Conduct FT3 
Test Scenarios 



® 

DAA 

Technical 
Standard 
Order (TSO) 


® 

C2 

echnical 

►tandard 

■Hor 

CL 

uer \ i ju ) 


DAA 

Technical 
Standard 
Order (TSO) 
1 — roVder 


RADAR 
echnical 
itandard 
(TSO) 
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Flight and Simulation Overview 
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Comprehensive Evaluation of Airspace Risk Threshold 
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Analysis 
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Red Status Line Date: 9/30/15 



UAS-NAS Project OV-1 

IT&E Technical Challenge: Backbone for Integrated Testing 


LEGEND 

_ Sense and Avoid (SAA/DAA Technologies) 

Air Traffic Services 

Control and Nonpayload Communications (CNPC) Network 
Legacy Command and Control (C2) Links 

ACRONYMS 

ADS-B: Automatic Dependent Surveillance— Broadcast 
DAA: Detect and Avoid 

T CAS— II: Traffic Alert and Collision Avoidance System 
TRACON: Terminal Radar Approach Control Facility 


UAS ground Human Systems 1 

control station Integration * 


Research ground 
control station 


Small UAS (sUAS) 
Mission Support Technologies 




UAS vehicle autonomy 


UAS Restricted-Use Certification 


Precision agriculture 


Air traffic services 
(TRACONs) ►> 



Outline 


UAS-NAS Overview 

Technical Challenge Performance - Debra Randall 

- TC-C2 

- TC-SAA 

- TC-HSI 

- TC-ITE 

Non-Technical Challenge Work 
Project Processes Implementation 
Project Level Performance & FY16 Look Ahead 
Review Summary 


Progress Indicator Definition 






Technical Challenge progress is tracked by means of Progress Indicators 



- Schedule Package (SP) L2 milestones are the data points for these plots 


Assessed individual contribution towards 
achieving the overall technical challenge 

- High = 2, i.e. Integrated Tests 

- Moderate = 1, i.e. multiple subproject 
technologies 

- Low = 0, i.e. foundational activities 

Results normalized and placed on a 10 
point maturity scale 

Progress Indicators, i.e. lower portion of 
the plot, represent execution/data 
collection of Project SP activities 

Tech Transfer (i.e. upper portion of the 
plot), plotted to coincide with execution, 
represents the data analysis and 
reporting of SP Activities 



^ Tech Transfer to 


♦ Complete 

1 RTCA 


0 In work / On track 

• (+ other orgs) 


0 In work / Late / Not impacting LI 
♦ In work/ Late/ Impacting LI 

Inputs from RTCA 


<0 Not yet started 

i 



<()L2 Milestone LI Milestone 


Progress is tracked against all the tasks in the schedule package using 
a red, yellow, green indicator 
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TC-C2: C2 Performance Standards 


UAS Integration 

• Airspace integration procedures and performance standards to enable UAS 
integration in the air transportation system 




Provide research findings to develop and validate UAS Minimum Operational 
Performance Standards (MOPS) for terrestrial command and control (C2) 
communication i— 


C2 

MOPS 


TC-ITE: Integrated 
Test & Evaluation 


TC-HSI: Human 
Systems Integration 



TC-C2: 

Command & Control 

Performance 

Standards 


TC-SAA: 

Sense and Avoid 

Performance 

Standards 
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TC-C2: Progress Indicator 
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3 

-hJ 

CD 


10 

9 

8 

7 

6 

5 

4 

3 

2 

1 

0 


SC-228 White Papers 
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C-Band Planning & Standards 
Interim Report [C.3.20] 


[ Comm System Per ImpactTesting [C.4.40] ] 
[ FT Series 3 [C.1.3oTl — 


[ FT Radio Model Development & Regional Sims [C.4.10] ] — 


[ ACES Sim Operations w/FT Models w/Gen5 [C.4.20Tl — 
[Recommendations for Integration of CNPC and ATC Comm Prelim [C.4.30ll-| 


Gen-5 
[C.1.30] 




Recommendations for 
Integration of CNPC and 
ATC Comm. Final [C.4.30] 


1 st CNPC Radio 
prototype Delivered/ FT 

Spectrum Allocation 
Terrestrial CNPC (WRC-12) 


Spectum Compatibility Analysis 
(WRC-2015) [C. 3.10] 


[ Develop & Test Security Prototype [C.2.10l1 


C-Band Planning & Standards 
Final Report [C.3.20] 



* 

Completion of 
Security Risk Assmt 



F* 





2012 
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Final Phase 1 


Final Phase 2 


MOPS July 2016 


MOPS July 2018 
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^ Complete 
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On Track 
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ONot Yet 
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Tech Transfer 
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(+other orgs) 


Inputs from 
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As of 9/30/15 
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Verify Prototype Performance 
Preliminary C2 MOPS Input 



• Research Objective: 

- Analyze the performance of the fourth generation Control and Non-Payload Communication System 
prototype in a relevant flight environment 



* Results, Conclusions, and Recommendations: 

- Demonstrated use of multiple ground stations and multiple aircraft during Gen-3 flight testing at Rockwell 
Collins in Cedar Rapids, IA 

- Completed development and testing of GRC T-34C surrogate aircraft using Gen-3 CNPC radios 

- Completed flight test of Gen-4 CNPC radios, using Rockwell Collins developed small-form-factor 1W radio 
hardware 

- Results of Gen-3&4 CNPC radio development and testing were delivered to RTCA SC-228 C2 working group 
for incorporation into Draft C2 MOPS 


CNPC Radio for Development and V&V of C2 MOPS 


Schedule Package: C.1.20 
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Performance Validation of Security Mitigations - Relevant 

Flight Environment 

• Research Objective: 

- Determine Control and Non-Payload Communication security recommendations for civil UAS operations 
based on analysis of flight test results 





* Results, Conclusions, and Recommendations: 

- Completed flight test of CNPC system security controls 

• Demonstrated strong mutual authentication between the end nodes 

• Demonstrated end-to-end confidentiality and integrity protection 

• Demonstrated seamless system functions to the end users and will dynamically create security associations as 
required to protect network flows 

- Flight test report was completed and released 

- Security requirements validated in this flight test were incorporated into the C2 Preliminary MOPS 


CNPC System Security Requirements for C2 MOPS 


Schedule Package: C.2.20 
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TC-C2: C2 MOPS Contributions 



NASA UAS-NAS Project Activities Key Products Resultant Outcomes 



C2 Performance Standards 


Develop 
C2 Prototype 
System 



Conduct C2 Flight Test 
and MS&A 

Data Link LOS 

CNPC Spectrum BLOS 

CNPC Security ATC Interoperability 



Develop C2 
Requirements 


C2 Performance 
Requirements to inform 



RTCA 


• 

C2 

MOPS 

* 

C2 

Technical 
Standard 
Order (TSO) 


• Data and text to Preliminary MOPS sections and appendices 

• Designed, developed, and tested (laboratory & flight) a prototype radio 

• Provided prototype radio performance from laboratory and flight tests to C2 
Working Group for Preliminary MOPS development 

• Developed a NAS-wide CNPC system simulation validated with flight test data 

• Technical report for ITU-R Working Party 5B to support Fixed Satellite Service 
(FSS, i.e. commercial satellite services) BLOS CNPC capability decisions 
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TC-SAA: SAA Performance Standards 


UAS Integration 

• Airspace integration procedures and performance standards to enable UAS 
integration in the air transportation system 




Provide research findings to develop and validate UAS Minimum Operational 
Performance Standards (MOPS) for sense and avoid (SAA) performance and 
interoperability 


TC-ITE: Integrated 
Test & Evaluation 


TC-HSI: Human 
Systems Integration 



TC-C2: 

Command & Control 

Performance 

Standards 


RTCA 


RTCA 

DAA 


RADAR 

MOPS 


MOPS 


TC-SAA: 

Sense and Avoid 

Performance 

Standards 
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TC-SAA: Progress Indicator 
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[Sub-function Tradeoffs w/ UAS Perf. [S. 1.401 } 
[Comprehensive Eval. Airspace Risk Threshold [S.2.80]] — 

[Effect of SAA Maneuvers w/Procedures[S.2.70j — 


DAA Self-Sep. Alerting Methods, 



CA/SS Algorithm Maneuvers vs. 
UA Performance Assrnt. [S.4.20] 


Interoperability of SS 
and CA Functions 
[5.1.30] 


Sensor Model Stress 
Testing & Sensitivity 
Analysis HITL [S.7.10] 


Alerting Times + CA-SS Integration 
Combined HITL [S.5.60] 


— | Surveillance Rqts {Med Fidelity) [S.1.20]! 
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SAA Traffic Display Evaluation HITL1 
(Joint w/HSI Part Task Sim 4) 

* Research Objective: 

- Evaluate integrated SAA system under perfect sensor conditions 

- Evaluate the pilot's ability to remain clear as a function of self separation threshold 

- Evaluate the pilot's acceptability of recommended Autoresolver maneuvers to avoid loss of Well Clear 

- Evaluate the utility of two different trial planner capabilities that aid an UAS in remaining Well Clear of other traffic 





And 

(Predlcted_Vertkal_Separatlon < Vwtlcal_Sep_Crtteria) or (Current Vertlcal Sep < Vertlcal Sep_Crlterla| 5 



@r_ 


Reduction in WCV Severity 



* Results, Conclusions, and Recommendations: 

- No significant difference in remaining Well Clear given self-separation alerts at 80 vs. 110 seconds 

- Pilots were almost never able to remain Well Clear when first alerted at 55 seconds to CPA or less 

- Incorporation of 'Advanced' DAA information and tools significantly reduced the proportion of Loss of 
Well Clear when compared to the 'Basic' configuration 

- Integration of DAA traffic information and tools with the pilot's ground control station did not significantly 
improve the pilots ability to remain well clear 

• Other human systems integration research reveals difference in response time and workload 


GCS Display & Well Clear Separation Requirements for DAA MOPS 


Schedule Package: S.2.10 
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GA-FAA (SAA Initial Flight Tests) 
Flight Test Participation w/IT&E 



• Research Objective: 

- Perform collaborative flight tests and demonstrations to evaluate, validate and refine simulation-tested 
SAA concepts in an actual flight environment with prototype airborne sensors, prototype C2 radio links, 
and prototype ground station information displays 



Display Guidance 
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* Interim Results, Conclusions, and Recommendations: 

- Self-separation guidance from Stratway+ was effective, stable, understandable, and usable 

- Matured data collection capability 

- Applied lessons learned to Flight Test Series 3 and Collision Avoidance Self-separation Alerting Times 
human-in-the-loop simulation 


DAA System Maturation for Development and V&V of DAA MOPS 


Schedule Package: S.6.10 
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TC-SAA: DAA and Air-to-Air RADAR MOPS Contributions 



NASA UAS-NAS Project Activities Key Products Resultant Outcomes 



SAA Performance 
Requirements to inform 
DAA and RADAR MOPS 



• Data and text to Preliminary MOPS sections and appendices 

• Further assessment of Well Clear definition 

• Further development of maneuver guidance algorithms 

• Data collection contributing to DAA alerting requirements and performance 

• Assessment of airborne radar intruder frequency and detection range 
sensitivity on Preliminary MOPS alerting requirements 

• Analysis of surveillance errors and other representative uncertainties in flight 
test and calibration of simulation models 

• Provide sample DAA algorithm 
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TC-HSI: Human Systems Integration 


UAS Integration 

• Airspace integration procedures and performance standards to enable UAS 
integration in the air transportation system 




Provide research findings to develop and validate human systems integration (HSI) 
ground control station (GCS) guidelines enabling implementation of the SAA and C2 
performance standards 
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Test & Evaluation 
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TC-HSI: Progress Indicator 
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Part-task Simulation 4: SAA Pilot Guidance 


• Research Objective: 

- Evaluate efficacy of minimum information SAA displays, potential improvements for advanced information 
features and pilot guidance, and integrated vs stand-alone GCS SAA displays 






* Results, Conclusions, and Recommendations: 

- Consistent advantage seen for Advanced over Basic displays 

• Faster Total Response Times compared to Basic 

- No significant differences between the Standalone and Integrated condition 

- Fern, L., Rorie, R. C., Pack, J., Shively, J., & Draper, M. (2015). An evaluation of detect and avoid (DAA) 
displays for unmanned aircraft systems: The effect of information level and display location on pilot 
performance. In 15th AIAA Aviation Technology, Integration, and Operations Conference (p. 3327) 


GCS Display Minimum Information Guidelines/Requirements for DAA and C2 MOPS 


Schedule Package: H.1.40 
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HSI IHITL Participation & Data Collection 


• Research Objective: 

- Evaluate an instantiation of the prototype GCS in relevant environment 






* Interim Results, Conclusions, and Recommendations: 

- Integration of guidance and auto pilot in the auto-resolver and auto resolver + vector planner conditions 
led to significantly faster pilot 'edits' 

- No other significant differences in pilot response times 

- Rorie, R. C., & Fern, L. (2015). The impact of integrated maneuver guidance information on UAS pilots 
performing the detect and avoid task. Proceedings of Human Factors and Ergonomics Society, Los Angeles, 
CA, Oct 26-30 


GCS Information Guidelines/Requirements for DAA and C2 MOPS 


Schedule Package: H.1.10 
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TC-HSI: DAA and C2 MOPS Contributions 



NASA UAS-NAS Project Activities Key Products Resultant Outcomes 



Human Systems Integration 


Develop 

Prototype 

GCS 



Conduct Human Factors (HF) Flight 
Test and MS&A 

Contingency Management SAA 

Pilot Response C2 

Autonomy Displays 



Develop HF 
Guidelines for 
SAA, C2 & GCS 


HF Performance 
Requirements to 
inform MOPS and 





# 

DAA 

Technical 
Standard 
Order (TSO) 


# 

C2 

echnical 
>tandard 
rder (TSO) 

H 


• Data and text to Preliminary MOPS sections 
DAA MOPS 

• Further development of alerting timeline and GCS display 

• Further development of maneuver guidance display 

• Evaluation of the effects of sensor uncertainty 

• Development assessment of TCAS/DAA interoperability 

C2 MOPS 

• Defined C2-related GCS information requirements enabling pilot management and 
monitoring of the C2 Link 

• Examined video considerations for UAS C2 in civil airspace 
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TC-ITE: Integrated Test and Evaluation 

- Test Infrastructure 

• Test infrastructure to enable development and validation of airspace integration 
procedures and performance standards 




Develop a relevant test environment for use in generating research findings to develop 
and validate HSI Guidelines, SAA and C2 MOPS with test scenarios supporting 
integration of UAS into the NAS 


RTCA 


RTCA j 

DAA 


RADAR 

MOPS 


MOPS 


TC-ITE: Integrated 
Test & Evaluation 


TC-HSI: Human 
Systems Integration 



TC-C2: 

Command & Control 

Performance 

Standards 


TC-SAA: 

Sense and Avoid 

Performance 

Standards 
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TC-ITE: Progress Indicator 



RTCA 

MOPS 


Tech 

Transfer 


3 

-hJ 

CD 


10 

9 

8 

7 

6 

5 

4 

3 

2 

1 

0 


Established LVC 
Infrastructure 


Established 
Connection to 
FAATech Ctr 


ADS-B 

Ikhana 

Demo, 


SC-228 White Papers 
Dec 2013 


Preliminary Phase 1 
MOPS July 2015 


A 


★ 

L 


■fFAAl 

T 


ITfaaI -, [+faa! [TfaaI 


[Comprehensive Relevant Env. Eval. [P.l.lQl] - 
[FT4 Relevant Env. Eval. Report [T.5.70f| - 
[Stakeholder Feedback Report [T.5.70]] - 
[Capstone FlightTest [T.5.60]| - 
[ FT Series 4 [T.5.60] 


[ FT3 Relevant Env. Eval. Report [TA60lh 


IFIITL Relevant Env. Eval. Report |T.2.60^ gp 


Initiate Flight 

Test Series 2 


IFIITL Sim 

Test Plan 
■ [T-2.20] , 


r FT 
Series 3 

UT.4 501 ) 


^[SAA Initial FT [T.3.40^ %i < ► 

[ ihitlT * ^ 

[[T.2.50]J ~m~ 



FT4/ Cap stone 
Flight Test Plan [T.5.50] 


2012 

2013 

2014 

2015 

2016 

2017 


Fiscal Year 



+ ; — ; ' 

Final Phase 1 


; — ; ' 

Final Phase 2 


MOPS Julv 2016 


MOPS July 2018 


A 


2013 


^ li/ap| 

Milestone 

0 L2 

Milestone 


^ Complete 

Q In Work / 
On Track 

<^> In Work/ 
Late - No 
LI Impact 

^ In Work/ 
Late - LI 
Impact 

ONot Yet 
Started 


Tech Transfer 
to RTCA 
(+other orgs) 


Inputs from 
RTCA 


As of 9/30/15 
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IHITL Relevant Environment Analysis 


• Objective: 

- Report on the Integrated Human-in-the-Loop Relevant Environment Analysis 





• Results, Conclusions, and Recommendations: 

— IHITL successfully utilized the LVC connections to distribute simulation activities between ARC/AFRC 
and ARC/LaRC 

• Emulation of actual Oakland and Dallas Ft. Worth airspaces 

• DAA algorithms performance evaluated with UAS pilots and ATC controllers 

• Latencies measured among distributed participating assets 

• UAS Pilot and ATC controller subjects provided feedback on the test environment and traffic scenario 
realism 


Test Environment for V&V of DAA and C2 MOPS 


Schedule Package: T.2.60 
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SAA Initial Flight Tests Execution 


• Research Objectives: 

- Conduct SAA Initial Flight Test using the Live, Virtual, Constructive test environment 

- Document the performance of the test infrastructure in meeting the flight test requirements 





* Results, Conclusions, and Recommendations: 

- Flight tests conducted in December 2014 

- 3 unmanned vs. manned flights and 55 encounters completed 

- Successful risk reduction activities completed to include SAA algorithm refinements, sensor 
noise modeling, sensor noise filtering, data collection and dissemination efficiencies, and 
flight test operations 


Test Environment for V&V of DAA and C2 MOPS 


Schedule Package: T.3.40 
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TC-ITE: DAA and Air-to-Air RADAR MOPS Contributions 



NASA UAS-NAS Project Activities Key Products Resultant Outcomes 



Integrated Test & Evaluation 


Develop LVC Test 
Infrastructure 



Conduct 

TC Specific Testing 


Re-usable Test 
Infrastructure 


► 


* t j 



Test Data for MOPS 
Development 


RTCA 


DAA 

MOPS 


RTCA 


RADAR 

MOPS 



# 


DAA 

# 

Technical 

RADAR 

Standard 

'echnical 

Order (TSO) 

standard 

b i 

rder (TSO) 


• Data provided to PEs and Partners for DAA and Radar MOPS development 

• Further development of live, virtual, constructive distributed test environment 

• Designed and developed a data archive scheme for integrated events 

• IHITL Relevant Environment Analysis 

• Completion of PT5 

• Completion of SAA Initial Flight Test Execution 

• Completion of FT3 Execution 
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Flight Test 3 Baseline Plan 



Top Level Research Goals: 

• Validate results previously collected during 
project simulation testing with live data 

• Sensor performance, uncertainty 

• State data uncertainty 

• Wind compensation 

• Inform final DAA MOPS 


Configuration 1 - Scripted Encounters 



• Live Ownship with Cooperative and Non- 
Cooperative Sensors 

• Live Intruder(s) 


+ 


Test fully integrated system in a relevant live 
environment 

• HSI Proof of Concept GCS and pilot guidance 
displays 

• CN PC performance 

• Inform final DAA and C2 MOPS 

Reduce risk for Flight Test Series 4 

• More complex multi-vehicle scenarios 


test 


Configuration 2 - Full Mission 
Evaluations 


• Live Ownship (Surrogate UA) 

^ • Live and Virtual Intruders 

• Representative Operational 
Mission 

• UAS Pilot Participants 
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FT3 Lessons Learned and FT4 Path Forward 


• Lessons Learned 

- Multiple integration deficiencies 

• Surrogate UA: Improper RGCS display of information; intermittent INS data dropouts; latency of 
aircraft response to pilot command (unrelated to CNPC performance; due to surrogate 
implementation) 

• LVC/RGCS: MACS display clutter and fidelity 

- Multiple causes 

• Requirement definition 

• Multi-Center end-to-end test planning 

• Shakedown, integration, and combined system checkout schedule and success criteria 

• Communication and Technical discussions 

• FT4 Path Forward 

- Post-FT3/FT4 Path Forward Meetings 

• #1 (8/24-25/2015): Technical and non-technical issue identification and discussion; Short-term 
actions identified and assigned 

• #2 (9/9-10/2015): Identified (single) FT4 Lead; first set of full mission ownship options 

- Decision Gate 1 (10/8/2015) 

• Triage full mission ownship options based on technical, development, or partnering/contracting risk 

- Decision Gate 2 (11/13/2016) 

• Select the best option (technical, cost, and schedule) 

• Identify actions for or approve changes to research portfolio 
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Technical Performance Summary 



• World Radio Conference 

— Fixed Satellite Service BLOS CNPC 
capability analysis 

• NATO and ICAO 

- Human Autonomy Teaming support 
— Provide HF leadership and expertise 

• Preliminary MOPS 

— Expertise influencing deliberations 


NASA UAS-NAS Project Activities 


Key Products Resultant Outcomes 




C2 Performance Standards 


Develop 
C2 Prototype 
System 




Conduct C2 Flight Test 
and MS&A 

Data Link LOS 

CNPC Spectrum BLOS 

CNPC Security ATC Interoperability 


SAA Performance Standards 

* 


Develop SAA 
Performance Testbed 


Develop SAA 
Interoperability Testbed 


Conduct SAA Flight Test 
and MS&A 


Performance Trade-offs CONOPs 
Interoperability Well Clear 

Self Separation Collision Avoidance 


Human Systems Integration 


Develop 

Prototype 

GCS 


Conduct Human Factors (HF) Flight 
Test and MS&A 

Contingency Monogement SAA 

Pilot Response C2 

Autonomy Displays 


Integrated Test & Evaluation 


Develop LVC Test 

r\ 

Infrastructure 



Conduct 

TC Specific Testing 

I 


Conduct SAA Initial 
Flight Test Scenarios 



Conduct FT3 Conduct FT4 Test 
Test Scenarios Scenarios & Capstone 


— Timely and valuable research findings from simulation, 
flight test, and integrated flight test 


- Narrative text to multiple sections and appendices 


• Future Research Portfolio shaping 

— Continuous involvement with SC-228 and FAA 


Poised to provide timely, valuable input to Final MOPS and international community 
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Outline 


UAS-NAS Overview 

Technical Challenge Performance 

Non-Technical Challenge Work - Davis Hackenberg 

- FY15 Non-TC Performance 

• Certification 

• sUAS 

• Augmentation 

- FY16 Look Ahead 

• Capstone 

• Future Project Planning 

Project Processes Implementation 

Project Level Performance & FY16 Look Ahead 

Review Summary 


Non-Technical Challenge Work 


• Non-Technical challenge work is technical work outside the core project focus areas 

- Includes far-reaching/higher risk activities with an emphasis on future (post-project) 
capabilities 

- Utilizes project management rigor, but to a lesser extent (i.e. No Progress Indicators) 

- Content is not required for min-success of the project 

- Does not have LI milestones 

• Source for resources should TC work encounter unknown risks requiring additional 
resources for mitigation 

• Long term activities have pre-defined off-ramps/on-ramps to facilitate potential TC 
work needs 

- Off-ramps: Clearly defined breakpoints/stopping places within scheduled activities 

- On-Ramps: New proposed activities that are aligned with the intent of Non-TC work 

• Non-TC Work on UAS-NAS Project 

- Certification 

- sUAS 

• Activities with on-ramp implications (being book kept as Non-TC work) 

- Augmentation used for LVC-DE Enhancements 

- Capstone Development and exemption 

- Future Project Planning and Full UAS Integration Analysis 
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FAA Organizational Relationships 



• The FAA is using several domestic forums, in conjunction with several international 
forums to lay out the pathway for their priorities and investments. 


FAA UAS Center of Excellence 
performs strategic research to 
guide the FAA, while the test 
sites contribute essential inputs 
through UAS testing 


World Radio Conference 
(WRC) and International Civil 
Aviation Organization (ICAO) 
UAS Study Group are 
addressing UAS access from 
an international perspective 


FAA UAS 
COE & 
Test Sites 


Inter- 

national 

Forums 


UAS 

ExCom 



SC-228 chartered to develop 
Detect and Avoid (DAA) and 
Command and Control (C2) MOPS 


UAS Executive Committee (ExCom): 
Senior gov't steering group focused 
on streamlining public UAS access 


UAS Aviation Rulemaking 
Committee (ARC) Developed civil 
UAS Implementation Plan based on 
the FAA UAS Concept of Operations 
(CONOPs) & Roadmap 


Office of Secretary of Defense (OSD) Sense 
and Avoid (SAA) Science and Research 
Panel (SARP): Chartered by OSD to 
identify SAA Research Gaps 


NASA has a leadership role within many domestic forums 
and participates in the international forums 


43 



Leveraged operational evaluation approach (agriculture sprayer) and 
FAA FARs (part 21 & 27) to develop a Mock Type Certification Basis 


A general approach to determining a type certification 
basis for UAS (leveraging a limited ConOps) 

An example concept of operations document with 
data needed to support airworthiness certification, 
and artifacts to help inform the UAS industry about 
civil certification 


Certification Usage and Highlights 



Geospatially 
constrained 
Farmland (rural 
area) 

< 400 ft altitude 
Line of sight and 
low visibility 
conditions 


• Design and performance criteria derived from hazard 
analysis and current regulations used to establish 


Applicability of Part 27 regulations to 
an unmanned ag rotorcraft 


— Airworthiness requirements for unmanned rotorcraft 
intended for "low-risk" operations 

- Requirements for new systems and equipment (e.g., a 
containment system for UAS) 

• Recognition that applying current airworthiness 
standards to UAS is challenging 

- Tailoring will be difficult for many UAS 
vendors/operators 

- Even for UAS operating in low-risk environments 


\ 



Excluded, 

43% 





Hazard-Based Approach 



Research Tasks 


Define ConOps and determine 
UAS platform 


I 


Identify hazards 
(Operational & Functional 
Hazard Assessment) 


Evaluate existing regulations 
against the primary hazards 
(Part 27 for rotorcraft) 


Create preliminary 
requirements for hazards not 
covered by existing regulation 


Intermediate Research 
Products 


-> ConOps Document 



Hazard Severity Definitions 



Primary UAS Hazard List 


Part 27 paragraphs that 
apply as is 

^ . Part 27 paragraphs that 
apply with simple edits 

Part 27 paragraphs to be 
distilled and elaborated ■ 

Evaluation Rationale 


y Draft requirements for 
UAS-unique functions 


Products used in the Mock 
Type Certification Basis 


-> G-1U Background 



FY15 Work 


G-1U Type certification basis 

New Information Issue Papers 

• U-l Controllability, Maneuverability, & Stability 

• U-2 Structural Integrity 

• U-3 Powerplant and Supporting Systems 

New Information Issue Papers 

• U-4 Containment 

• U-5 DAA Intruder Aircraft 

• U-6 DAA Persons and Objects within 
Containment Area 

• U-7 Safety Critical Command and Control 
Datalinks 



Follow-on work: examine affects of different vehicle characteristics and 

operational modes certification basis 
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Cert Relationship to FAA Integration Initiatives 



• FAA Pathfinders 

- Visual line-of-sight operations in urban areas 

• CNN will look at how UAS might be safely used for news gathering in 
populated areas. 

- Extended visual line-of-sight operations in rural areas 

• PrecisionHawk will explore how UAS flights outside the pilot's direct vision 
might allow greater UAS use for crop monitoring in precision agriculture 



operations. 


- Beyond visual line-of-sight in rural/isolated areas 

• BNSF Railroad will explore command-and-control challenges of using UAS to 
inspect rail system infrastructure. 


• UAS ARC 

- "Pathfinders" concept as was part of FAA ARC 
Implementation Plan 

- "Pathfinders" also relevant to ARC BVLOS Working 
Group use cases 

• RTCA SC-288 


Use case, CONOPS, and vehicle size relevant to P2 
MOPS 
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sUAS Mission Support Technologies 

Level Research Goal 



- Developing specific data relevant to partner Agencies while 
conducting high-value sUAS missions utilizing increasing levels of 
automation and sUAS technologies 

• Objectives 

- Assess the state-of-the-art in sUAS Sense-and-Avoid capabilities 

- Develop and test one instantiation of an sUAS SAA system 

- Assess feasibility of BVLOS operation at GDS in Class G airspace 

• FY15 Accomplishments 

- A series of test conducted to obtain video and telemetry data for 
various encounters of sUAS platforms 

- Flight tests leveraged an Electro-Optic (EO) cameras 

- 11 single UAS buildup flights, and 12 multi-UAS encounter flights 

- Diverse weather conditions 




Y-6 Hovers in place 



- Initial indications seem to show we were getting good data, with 
internal and partner analysis happening in the coming weeks 
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sUAS Relationship to FAA Integration Initiatives 


UAS ARC 

- DAA necessary for many (if not a 


ARC BVLOS use cases 


RTCA 

- Use case, CONOPS, and vehicle size may be relevant to Phase 2 MOPS 

- If technology development is successful, RTCA and NASA will have 



• Sensor characterization of a P2 MOPS relevant sensor 

• System capable of representing requirements that would relate to the 
expected SC-228 P2 TOR 
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UAS-NAS FY15 Augmentation Details 


• Purpose 

- LVC Enhancements that would benefit the 
development of Phase 2 MOPS 

• Overview 

- The Project began planning for an Augmentation 
(congressional add) as early as December 2014 

- Project developed multiple review packages to 
coordination scope of tasks across ARMD and 
multiple projects 

- Augmentation tasks have all been successful 
thus far 

- Financial summary: 99.99% Obligated, 43% Cost 

• Augmentation task 3.3 completed, all other tasks 
are still in work 

• Prototype connections to Test Sites was more expensive than anticipated due to late 
changes to the LVC Prototype Connection task, and the desire to fund all 6 Test Sites 


Tasks 


3.1 Prototype connection equipment & test 
site connections 

3.2 LVC connection to scaled vehicles 

3.3 Investigation of ideal middleware 

4.1 VFR Traffic Model Development and 
Integration 

6.1 Distributed Display Infrastructure Set-up 

7.1 SatCom emulation capability on LVC 

7.2 Adaptable SAA Architecture and LVC 
Connection 
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UAS-NAS LVC-DE Build (including Augmentation Tasks) 


Research GCS 
Ikhana MQ-9 
Ikhana Simulator 

Ikhana ARP 

Distributed Display 
(2 way) 


NASA Armstrong 


Air Traffic Control 
Vigilant Spirit GCS 
Background Traffic 
B747 Simulator 

VFR Traffic Models 

Video Server 

Distributed Display 
(2 way) 

NASA Ames 



T-34C (Surrogate) 


Air Traffic Control 
MACS GCS 




S-3B 


SatCom Emulation 


Distributed Display 
NASA Glenn 


Background Traffic 
Airstar UAS 
Distributed Display 
Full LVC Node 

NASA Langley 





Flight Control 


UAS GCS 

Alaska Test Site 

ND Test Site 






SRC LSTAR 


MOCC 

NY Test Site 

Virginia Test Site 




NUANCE Lab 


LSUASC HLA 

Nevada Test Site 


Texas Test Site 


LEGEND 

□ Organizations/Clients 

— Existing connectivity 

As required 

FY15 Augmentation 
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Outline 


UAS-NAS Overview 

Technical Challenge Performance 

Non-Technical Challenge Work - Davis Hackenberg 

- FY15 Non-TC Performance 

• Certification 

• sUAS 

• Augmentation 

- FY16 Look Ahead 

• Capstone 

• Future Project Planning 

Project Processes Implementation 

Project Level Performance & FY16 Look Ahead 

Review Summary 


Capstone Overview 

Capstone is a mission-oriented demonstration subproject technologies, concepts, 
and procedures (rather than experimentally designed test series) 

The flight demonstrations will showcase the technologies developed by the Project, 
specifically related to RTCA Phase 1 MOPS 

A demonstration leveraging simultaneous flight of DAA and C2 systems utilizing the 
LVC-DE will be performed 

- DAA demonstration on Ikhana will include designed encounters integrated into a mission- 
oriented demonstration in R-2515 and will occur following FT4 

- C2 Terrestrial technologies will be demonstrated on the S-3B after Gen-5 radio Flight Tests 

- LVC will be leveraged to receive data from the Ikhana aircraft, provide that data to the 
algorithms and displays, provide a distributed video streaming capability, and "co-locate" 
Ikhana and S-3B 


- All four Centers and Technical Challenges will participate 


Capstone is being coordinated with FT4 planning activity; date of execution will be 
chosen with consideration for all project related activities 

DAA C2 LVC-DE 



Ikhana 






Capstone ConOps 


• Fly live aircraft out of AFRC and GRC, translated into a virtual airspace 

- Virtual background traffic from LaRC 

- ATC from ARC 

- Stream video across all 4 centers 

• Conduct checkout flights and full rehearsal in conjunction with FT4 and C2 testing 





DAA 

Encounter 


AFRC 


in 


Transpose flights onto 
virtual airspace 


GRC 


Virtual/Constructive 

Intruders 


ARC 


LVC Distributed 
Environment 


ARC/LaRC 
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Future Project Planning 


Background: Project Baseline 

- The Phase 1 MOPS UAS-NAS Project baseline incorporated a roll-off of personnel 
Q4 FY16, and then leveraged Q1 FY17 to complete the project and required 
reporting 


Current FY16 plans 

— The project must burden current resources in FY16 to transition into P2 MOPS due 
to current cost/risk/schedule 

• FY16 reserves are being allocated to support FT4 

• FY16 resources are being adjusted to transition for effective execution of P2 MOPS 
support 

• P2 MOPS RFI/RFP development for partnerships (primarily C2 and DAA) 

• Content Decision Process planning leverages Full UAS Integration Analysis 

Activity may synchronize with planning for other UAS Full Integration Projects 



Full UAS Integration Update 



• Full UAS Integration Analysis is intended to provide a systematic means for ARMD to evaluate 
UAS research areas and assist in portfolio decisions 


• FY15 analysis updates include 

- Source documentation updated to reflect current industry needs 

- Developed "100% complete" definition for all sub bins 

- Gap analysis performed for all bins 

- Opportunity/Risk/Benefit process for all Gaps refined through ARMD meetings 

- Lead, Collaborate, Leverage ground work laid 


• Initial familiarization and coordination across NASA ARMD 

- ARMD Analysis Board 

- UTM Project Manager inputs 

• MOE process (agenda, attendees, goals, etc) defined and ready to vet within NASA ARMD 


ARMD UAS Full Integration 

Portfolio Prioritization Process 




3. PRIORITIZE 




Prioritize Remaining Gaps 

Benefit adjusted^ Opportun ity / Risk Tornado Diagram 


Risk 


Opportunity 




The Content Decision Process is comprised of three major steps: 

• Define : identify supporting evidence and determine how best to use 

• Assess: Determine what has been accomplished to date, what is still 
remaining to do, and how much is yet remaining 



Prioritize : Apply weighting criteria to remaining gaps to determine the largest 
opportunities, benefits and risks to achieving/not achieving the outcome 
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Future Project Planning Resources 



• Planning Resources 


• Risk to Potential early investment activities due to Project 
reserve availability 

— RFI/RFP develop and execution 
- DAA/C2 trade studies 

— DAA/C2 early procurement 
activities 

• Other ARMD uses of UAS Full 
Integration Analysis would cause 
additional impacts 
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UAS-NAS Overview 

Technical Challenge Performance 

Non-Technical Challenge Work 

Project Processes Implementation - Davis Hackenberg 

- Project Rigor 

- Significant Changes against Baseline 

- Risk Management 

- FT3 Example 

Project Level Performance & FY16 Look Ahead 
Review Summary 



Project Rigor 



• Due to the limited lifecycle of the Project, and importance of delivering 
commitments on time, the project has implemented rigorous management 
processes 

• Rigor was re-evaluated and outcomes presented at the FY14 Annual Review 

- The project took steps to balance rigor with other time/overhead burdens 

- The Project team supported and understood the need for rigor 

• The Project processes 

— Were instrumental in FY15 successes 

— Had room for improvement in FY15 

• A review of the project processes with a focus on FT3 provides insight into 
process strengths and weaknesses 
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Project Document Tree 


Project 


Technology Development Project Plan 
[UAS-PRO-1. 1-004] 


SSI, Communication, HSI & Cert Subprojects 


Subproject 

Implementation Plans 

[UAS-SSI-4.1-001] 
[UAS-HSI-4.2-001] 
[UAS-COMM-4.3-001] 
[UAS-CERT-4. 4-001] 


Center 

Policy/Procedures 


Risk/Resource Management Process 



Change Management Plan 

[Resides in the Project Plan] 

■ 

^B 

[UAS-PRO-1. 1-002] 

Integrated Master Schedule 

Schedule Management Plan 

[UAS-I MS-1. 1-002] 

^B 

^B 

[UAS-PRO-1. 1-008] 

Public Outreach Plan 

Data and Information Sensitivity Plan 

[UAS-OR-7. 0-001] 

^B 


[UAS-PRO-1. 1-010] 

Systems Engineering Management Plan 

Project Requirement Document 

[UAS-PRO-1. 1-007] 

^B 


[UAS-PRO-1. 1-005] 

Records Retention Schedule 

Technology Transfer Plan 

[UAS-PRO-1. 1-003] 



[UAS-PRO-1. 1-006] 


IT&E Subproject 


Subproject Implementation Plan 
[UAS-ITE-5. 1-001] 


Configuration 
Management Plan 


Risk Management 
Plan 


Mishap 

Preparedness & 
Contingency Plan 





Software 

Development Plans 


Safety and Mission 
Assurance Plan 


Verification & 
Validation Plan 


Ce 

Policy/P 



Primary processes leveraged by examples 


Secondary processes leveraged in this section 

























Significant Changes against the Baseline 


TC-SAA: Schedule Package Changes 

- Closed/eliminated SP S.3.20, "Well Clear Alerts/Resolutions with VFR and Pilot/Controller 
(ACES Simulation)" and added SP S.3.30, "Well Clear Alerting Logic, Methods, and 
Performance Requirements" to provide greater benefit to SC-228 by conducting work of 
greater importance to SC-228 

TC-ITE: FT3 Completion 

- FT3 completion change request was primarily based on completion of FT3 Config 1 (11 
flights) on July 24, 2015 and the decision to cease data collection for Config 2 (8 system 
checkout flights and 3 data collection flights) on August 13, 2015. The LI Milestone was 
closed on August 13, 2015 

- Deleted the FT3 related HSI research products and deliverables 

Non-TC: Certification L2 Milestone Deletion (off-ramp) 

- Goal Structured Notation (GSN) Safety case did not meet the original intent of the deliverable 

Non-TC: sUAS Addition of New Work (on-ramp) 

Project Office: Reserve Allocations 

- Multiple change requests to allocate Project Office reserves to Technical Challenge areas 


U AS- NAS Top Risks 



Risk Matrix 




W - Watch 
R- Research 


C- Close 



Current Risks 
9/24/2015 


Mitigate 12 

Watch 5 

*Top Risks 5 + (1 IASP) 


Risks presented at 
FY14 Annual Review 


26 

3 

7 + (1 IASP) 


LxC Trend Approach 

-J3L Decreasing (Improving) A- Accept RA- Raise 
tT Increasing (Worsening) M- Mitigate E- Elevate 
Cl) Unchanged 

(T) Indicates a Top Risk 



Risk ID 

Trend 

LxC 

Target 

LxC 

Approach 

Risk Title 

4.1.11 

■=> 

3x3 

2x2 

M 

Validation of SAA Sensor 
Models 

5.1.11 

■=> 

3x3 

1x3 

M 

Required Assets for Flight 
Test 4 (FT4) not 
available during test period 

5.1.8 

■=> 

2x3 

1x3 

M 

Distributed Test Environment 
requirements for Integrated 
Flight Test 4 (FT4) not 
defined 

1.1.10 

if 

2x3 

2x3 

M 

Output from Test Events has 
value to Project Stakeholders 

IASP 

02 

■=> 

2x3 

lxl 

M 

Project Focus Changes Due 
to External Influences 

1.1.12 

NA 

3x5 

3x3 

W 

RTCA SC-228 Requirements 
Development Delay 


As of 9/30/15 

Changes Since FY14 Annual Review 

Added 7 risks, closed 19 risks, and accepted 1 Risk 

Interdependent Project Risk 
Asset availability - multiple 
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Process Successes and Areas for Improvement 

FT3 Example 
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- Resource Allocation and Utilization 

- Schedule 

- Requirements Summary 

- Partnerships and Collaboration 

- FY15 Accomplishments and FY16 Look Ahead 

• Review Summary 
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Resource Allocation against Baseline Budget 
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Resource Utilization FY15 Budget vs. Actuals Summary 


Successful Workforce and Resource Utilization 




Non-WYE Funding 
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FY15 Schedule Performance 



FY15 Milestone Count 

- Planned FY15 Milestones: 54 

- Milestones completed in FY15: 51 

Causes of Milestone Delays 

- Issues identified during testing or 
preparation for testing 

- Test scope increased due to SC-228 
additional requirements; results in: 

• Extended data collection 

• Extended analysis 

- Export control/release process exceeds 
planned duration 

Impacts of Milestone Delays 


Milestone Completion 
(Actual Date relative to Commitment Date) 

25 


C 

3 



Variance from the Commitment at Completion 


- No impact to Preliminary DAA or C2 MOPS 

- Acceptable impact to downstream test/simulation 
activities 


Successful Milestone Management 
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Milestone Summary 


Milestones 

2013 

2014 

2015 

2016 

FY2013 

FY2014 

FY2015 

FY2016 

6 7 8 9 1 

lo ii i; 

>123456789] 

lo ii i; 

>123456789 

io ii i; 

112 3 4 

5 6 7 8 9 

[TC-SAA/TC-HSI] SC-228 DAA 
Preliminary MOPS Comments/Inputs 



[TC-SAA,TC-HSI] SC-228 DAA Final 
MOPS Comments/Inputs 

« tic* 

A 


[TC-C2] SC-228 C2 Preliminary MOPS 
Comments/Inputs 




[TC-C2] SC-228 C2 Final MOPS 
Comments/Inputs 



[TC-ITE] IHITL Sim Complete / FY14 
APG 



[TC-ITE] SAA Initial Flights Tests 
Complete 

l 

l 


[TC-ITE] Flight Test Series 3 Complete 

1 ^1* 

l 1 

' 

[TC-ITE] Flight Test Series 4 Complete 


T 3T 

syr^. — 

!' | | ;!;;!!! 0* 

1 1 i i 

' ■ ! 1 


i 

API FY 2015 

★ ♦♦ ft 

i 



API FY 2016 

i 

j M M M 

ft ☆ 

Comprehensive Relevant 
Environment Evaluation 


oo ft 

Project Office 

♦ ♦ 

Ji 

Non-TC 

♦ H ♦ ♦ 

X> <|> 

ft API ft Level 1 <0> Level 2 


Red Status Line Date 9/30/15 



Behind Schedule 

"U6317 [SP S.1.20] Surveillance 
Requirements (Medium Fidelity) 
Brief results" 

Commitment Date: 9/3/15 
Estimated Date: 10/15/15 

"U6826 [SP S.3.30] SAA Self 
Separating Alerting Methods, 
Performance, and Robustness 
Study Phase 2 - Document results 
in final report/briefing" 

Commitment Date: 9/30/15 
Estimated Date: 10/15/15 

"U5597 [SPT.5.10] Capstone Test 
Requirements to Stakeholders" 
Commitment Date: 8/14/15 
Estimated Date: 10/2/15 
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• FY15 Status 


Project Requirements Summary 







- FY15: 18 Requirements completed 

- Project Total: 

• 30 Requirements completed 

• 45 Requirements remain 

- Total Requirements decreased 
from 76 to 75 during FY15 

Four Requirements were deleted 

- TC-SAA ACES Simulation Deleted 

- Capstone Planning Document 

- Standalone FT4 Test Plan 

- Report on the HSI results from FT3 

Three Requirements were added 

- Comprehensive Research Report 

- TC-SAA ACES Simulation Added 

- Created a combined FT4 Test Plan and 
Capstone Planning Document 


TWP 

End of 
FY14 

End of 
FY15 

FY15 

Completed 

Total 

Completed 

SAA 

29 

29 

6 

10 

C2 

17 

17 

5 

6 

HSI 

13 

12 

2 

6 

ITE 

13 

12 

3 

6 

PROJ 

4 

5 

2 

2 

Total 

76 

75 

18 

30 


• Impacts of Requirements Changes 

- No significant impact as a result of these changes 


Integrated Master Schedule UAS-IMS-l.l-002-015jpl50924a 
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Current and Anticipated Partnership Issues 
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Current Active Collaborations/Partnerships Status 



Partner 
(Project Area) 

Agreement 
In Place 

Collaboration/ Partnership Role 

AFRL 

(TC-HSI) 

Task Order 

Coordinate activities on Vigilant Spirit Control Station. 

Status: On-going collaboration with AFRL supporting use of VSCS on HSI 
activities 

Dragonfly Pictures 
(Non-TC-Certificotion) 

SAA 

Supporting the UAS certification case study by supplying the design of a UAS 
rotorcraft 

Status: Agreement in place for in-kind work, on-going 

FAA UAS 10 
(Project Office) 

MO A 

Support by FAA leadership, management, and technical SMEs to validate work 
being done by the Project 

Status: On-going coordination of Project deliverables 

FAA R&D Integration 
(Project Office) 

MOA 

Formal host of partnership agreements and collaborator for Integrated Test 
Activities 

Status: On-going coordination of Project deliverables 

FAA TCAS Program 
Office (ACAS Xu) 
(TC-SAA) 

Software 

Coordinating on collaboration for ACAS-Xu software and associated flight tests 
Status: Successful SAA Initial Flight Tests 

FAA UAS Test Sites 
(Project Office) 

IDIQ Contract 

Support of Task 1, UTM, and support of Task 2, LVC-DE efforts 

General Atomics 

(TC-ITE) 

SAA 

Ikhana equipped with avionics and Proof of Concept SAA system directly 
supported by UAS-NAS Project 

Status: Agreement in place with GA for SAA Initial Flight Test and FT3 and FT4 
for in-kind support 


Purple text indicates changes since FY14 AR 
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Current Active Collaborations/Partnerships Status 



Partner 
(Project Area) 

Agreement 
In Place 

Collaboration/ Partnership Role 

Honeywell 

(TC-ITE) 

Contract 

Sensor data fusion support 

Status: Supported FT3. Provided a Traffic alert and Collision Avoidance System 
(TCAS) II and ADS-B equipped intruder aircraft. 

NASA SASO 
(Project Office) 

NA 

Coordination with AOSP on UTM and other activities 
Status: Collaborative effort working with FAA Test Sites 

OSD SAA SARP 
(Project Office) 

NA 

Assess SAA research gaps and generate recommendations to RTCA SC-228. 
Status: Project serves as board member for SARP. Project actively participates in 
SARP activities 

Rockwell Collins 
( TC-C2) 

Cooperative 

Agreement 

CNPC radio development and flight test. Cost sharing with Rockwell Collins 
concentrated in FY11-13, totaling $3M contribution from Rockwell. 

Status: Rockwell Collins delivered Gen-4 and Gen-5 radios 

RTCA SC-228 
(TC-C2, TC-SAA) 

NA 

Conduct modeling, simulation and analysis to support the development of 
MOPS 

Status: On-going support to DAA and C2 working groups 

NASA SMART NAS 
(Project Office) 

NA 

Coordination with SMART NAS Project on FY15 Augmentation tasks 
Status: Collaborative effort working on LVC/SMART NAS enhancements 

UND 

(Non-TC-Certificotion) 

SAA 

Exploring requirements for safe operation of UAS through a series of case 
studies, experiments and flight evals. 

Status: On-going collaboration and in-kind support 

University of South 
Carolina 

(TC-C2) 

Grant 

Develop channel models from RF channel sounding data and analysis of flight 
test data for channel fading and multipath effects. 


Purple text indicates changes since FY14 AR 
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FY15 Accomplishments & FY16 Look Ahead 


FY15 Accomplishments 

• Supported RTCA SC-228 and contributed to DAA and C2 Preliminary MOPS 

• NASA IDIQ. contract with all 6 FAA UAS Test Sites Established 

• TC-SAA, TC-HSI, TC-ITE: SAA Initial Flight Test Successfully Executed 

• TC-HSI, TC-SAA, TC-ITE: Part Task Simulation 5 Successfully Executed 

• TC-C2: CNPC Gen-4 Flight Test Successfully Executed 

• TC-SAA: CASSAT Successfully Executed 

• TC-SAA: ACES Simulations Successfully Completed 

• Non-TC [Cert]: Restricted Category Type Certification Report Successfully 
Completed 



• Non-TC [sLIAS]: Video Data Base Flight Test Successfully Executed 

• NASA Honor Awards: ACAS-Xu and Self-Separation Group Achievement 
Award (TC-SAA, TC-HSI & TC-ITE), Langley Group Achievement Award (TC- 
SAA), Exceptional Leadership Award (TC-ITE), Exceptional Service Medal (PO, 
TC-HSI), Early Career Achievement Medal (PO) 

• NASA X UAS-NAS Project Video won the Capital Region Emmy Award within 
the Informational/Instructional Category 

FY16 Look Ahead 

• TC-SAA, TC-C2, TC-HSI, TC-ITE: Flight Test Series 4 

• TC-HSI, TC-SAA: Part Task Simulation 6 

• TC-C2: CNPC Gen 5 Flight Test 
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FY16 Potential Storm Clouds 

• FY16 Project Portfolio 

- Under examination to assess if original baseline plans have the right priorities 

• Working with SC-228 leadership for their prioritization of planned activities 

• Major Test Activities 

- Flight Test Series 4 (FT4) 

• Path forward in work following decision to cease FT3 full mission data collection 

• Multiple options for full mission ownship 

• Potential Technical, Cost, Schedule impacts 

• FY16 API 

— FT3 & FT4 execution and subsequent research findings contribute to the FY16 API 

• SC-228 

- Stakeholder interest in Project test activities may impact FY16 Research Portfolio 

• Resource Impact 

- FT4 path forward execution still in work; potential to exceed baseline budget 

- Potential IT&E workforce impact as a result of FAA UAS test site activities 

• Potential Phase 2 MOPS Support Follow-on Project 

— Planning may impact FY16 Project baseline execution 
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FY15 Summary 

■S Successful execution of Project Phase 2 Portfolio 

- Executed multiple ground tests, simulations, and flight tests 

- FY15 Annual Performance Indicator (API) 

S Balanced rigor with timely and effective project management 

- Incorporating process lessons learned 

S Enhanced LVC distributed test environment with augmentation spending 
S Integral member of RTCA SC-228 



Delivered research findings and subject matter expertise 
integral to DAA and C2 Preliminary MOPS 


75 


UAS-NAS Overview 
Backup Slides 
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• Step 


• Step 


• Step 


• Step 


• Step 


Phase 2 Content Decision Process 



1: Identify Community Needs 

The Community Needs were collected from several strategic guidance 
documents that identified challenges preventing civil and commercial UAS 
from routinely operating within the NAS 



2: Define and Apply Filters 

Filters were selected to assess which community needs were relevant to 
NASA, ARMD, and the Project 

Filters: NASA & ARMD Mission , ARMD Skills/Capabilities, Project Time Frame 

3: Map to Focus Area Bins 

Community needs that made it through the filters were binned into affinity 
groups 




4: Team Refine Sources and Bin Mapping 

Top Down (Project Office) and Bottoms Up (PEs & DPMfs) approaches come 
together to achieve consensus on sources and bins 

5: Applying Weight Criteria and Prioritization 

Prioritization used to identify lower priority community needs that the 
Project should not pursue for Phase 2 

• Weighting Criteria: Community Needs , Appropriate Organization, Ability to 
Complete, Complexity & Testing, Public Outreach/Acceptance 
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Phase 2 Content Decision Process (cont.) 


Step 6: Community Progress Assessment 

- Evaluates the progress made towards addressing the community needs by NASA 
and other government/industry organizations to identify the remaining gaps 

Step 7: Team Identify Technical Work Packages 

- Project Managers and Technical Leads provided assessments of which community 
needs the Project should be contributing towards in Phase 2 

Step 8: Project Office Validate Proposed Technical Work Packages 

- The Project Office reviewed the proposed TWPs supplied by the team and evaluated 
them according to many factors including: Consistency with existing Phase 1 plans, 
lessons learned, and Phase 2 Drivers 

Step 9: Develop Detailed Plans for Validated Technical Work Packages 

- Project Managers and Technical Leads developed detailed proposals for TWPs that 
address the UAS Community Needs 

Step 10: Perform Cost, Benefit, and Risk Analysis for all Potential P2 Work 

- The Project Office evaluated each Technical Work Package in the areas of cost, 
benefit, and risk to generate an initial portfolio 

- Initial portfolio was evaluated for additional considerations, including: Support of 
Phase 2 Drivers, UAS Subcommittee Feedback, and results of the Center 
Independent Cost Assessments 




FAA Influence on Project Phase 2 Portfolio 


The FAA Concept of Operations (CONOPs) and 
Roadmap establish the vision and define the path 
forward for safely integrating civil UAS operations 
into the National Airspace System (NAS) 

The Civil UAS Implementation Plan builds upon 
the FAA CONOPs and Roadmap by defining: 

— The FAA Aviation Rule Making Committee (ARC) view of the 
activities needed to safely integrate UAS 

- An initial plan for means, resources and schedule necessary 
for the aviation community and stakeholders to safely 

and expeditiously integrate civil UAS into the NAS 


NASA UAS Integration in the NAS Project Role 

- Leverage strategic material developed through the FAA (and 
partners) to ensure NASA portfolio will transfer to UAS 
integration 

- Continue partnership with the FAA to develop technologies 
and standards, and necessary planning material, throughout 
the life of the project 



ttflj Federal Aviation 
Administration 


Integration of Unmanned 



Into the National Airspac 

Integration of Civil UAS into the 

Concept of Operations 

National Airspace System 


(NAS) 

• — 

Roadmap 





The FAA 
CONOPs & 
Roadmap 
establish 
the vision and 
define the 
path forward 
for Civil UAS 
Integration 
into the NAS 


Integration of Civil Unmanned Aircraft Systems (UAS) 
In the National Airspace System (NAS) 


Implementation Plan 



The Implementation Plan 
defines the means, resources, 
schedule, activities and 
structure for realizing the FAA 
CONOPs and Roadmap. 
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UAS-NAS Technical Challenge Performance 

Backup Slides 
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Gen-2 Radio in Relevant Environment Flightiest 


• Research Objectives: 

- Analyze the performance of the second generation CNPC System prototype in a relevant flight 
environment 





* Results and Conclusions: 

— Demonstrated fluid transition "hand-off" of aircraft CNPC signal between two CNPC system ground stations 

- Demonstrated operation of remote CNPC system ground terminals through network 
— Measured data link transmission/reception times 

- Testing of the 2nd generation CNPC system demonstrated the ability to meet the initial SC-203 performance goals 

- Results from the test were analyzed and delivered to SC-228, providing validation data and technical basis for the 
draft C2 MOPS 

- Flight Test Report was completed and released 


CNPC Radio for Development and V&V of C2 MOPS 


Schedule Package: C.1.10 
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Develop and Test Security Prototype 



• Research Objective: 

- Define CNPC security recommendations for civil UAS operations based on analysis of laboratory test 
results 



* Results, Conclusions, and Recommendations: 

- Implemented security mitigations identified in previous project studies 

- Performed full end-to-end testing of system in laboratory environment, utilizing Gen-2 radio hardware 

- Developed baseline for overhead and latency imposed by the recommended security measures 

- Results from the test were analyzed and delivered to SC-228, providing validation data for the security 
portions of the draft C2 MOPS 

- Test report was completed and released 


CNPC System Security Requirements for C2 MOPS 


Schedule Package: C.2.10 
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Spectrum Compatibility Analysis 


• Research Objective: 

- Develop data and rationale to obtain appropriate frequency spectrum allocations to enable the safe and 
efficient operation of UAS in the NAS 





* Interim Results, Conclusions, and Recommendations: 

— Developed and delivered Annex 7 to ITU-R M.[UAS-FSS] report (Sharing studies on emissions from fixed satellite 
service earth station transmitters on-board unmanned aircraft into incumbent terrestrial services) 

• Conclusion is UA Fixed Satellite Service (FSS) transmitters do not cause Fixed Station (FS) protection criteria to be exceeded at 

altitudes > 9 000 feet AGL and latitudes up to 70 degrees for 14.0-14.47 GHz 

• Conclusion is UA Fixed Satellite Service (FSS) transmitters do not cause Fixed Station (FS) protection criteria to be exceeded at 

altitudes > 3 000 feet AGL and latitudes up to 70 degrees for 27.5-29.5 GHz 

— Results are being delivered at the 2015 World Radiocommunication Conference to support the allocation of Ku & 
Ka Band frequencies for UAS operations 


CNPC Frequency Spectrum Allocation Requirements for C2 MOPS 


Schedule Package: C.3.10 
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Flightiest Radio Model Development and Regional Sims 



• Research Objective: 

- Develop validated radio models, based on flight testing and development of performance profiles to be 
used during regional large scale simulations 


Start of Data Collection May 2015 

Propagation data integration 



* Interim Results, Conclusions, and Recommendations: 

- Update of radio models to Gen-5 FT radio implementation completed (early Sept) in Opnet 

• New CNPC Gen-5 waveforms and calibrations 

• New logic/messaging for CNPC connection establishment, authentication, waveform changes and handoffs 

• IPv6 with Mobility and Compression. Networked GS operation 

• CNPC data traffic profile changes by domain (airspace) and class (UA Class) 

• Inclusion of flight test propagation models data in Opnet 

• Inclusion of L-band ground antenna model characteristics 

- Currently working integration of Gen-5 model and its supporting ground station infrastructure into large-scale simulation 

- Model validation testing with Gen-5 radios is in progress in GRC lab 


CNPC Radio Simulation Development for Development and V&V of C2 MOPS 


Schedule Package: C.4.10 
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Recommendations for Integration of CNPC 

and ATC Comm 


• Research Objective: 

- Develop inputs to preliminary and final SC-228 C2 WG MOPS based on simulations conducted in OPNET 
and ACES Large-scale environments using specific MOPS and NAS Comm Architecture operations 
scenarios 






SC4(AtHo) An** (XMMiMc 


SC4(AUto) AfTtv* U|*f* 


frame p«yfe»4 fee 





* Interim Results, Conclusions, and Recommendations: 

- Completed simulations and delivered results to SC-228 C2 WG, to define parameters for Gen-5 V&V radio 

- CNPC and ATC Comm integration simulations to be run in March 2016 with Gen-5 radio model 

• Simulation analysis will look at the ability/performance of ATC communications in providing continued piloted aircraft 
ATC with ATC required for UA aircraft operations. UA Classes above sUAS for ATC 

• Comparison of Relay vs. non-Relay architecture performance 

• Varied air-traffic scenarios for mixed operations 

• Evaluated for performance, safety, reliability 


NAS-Wide CNPC System Simulation for Development and V&V of C2 MOPS 


Schedule Package: C.4.30 
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Communication System Performance Impact Testing 

(Delays/Capacity) 

• Research Objective: 

- Perform large-scale NAS simulations to assess impact of UAS on the NAS communications operations with 
different operating concepts and for different control and non-payload communication system 
architectures 





* Interim Results, Conclusions, and Recommendations: 

- Simulations are using Gen-5 Radio model 

- Simulation analysis will look at the performance impact on NAS ATC communication, Datalink 
Communication and CNPC uplink and downlink for C2, Telemetry, Wx, DAA, and Navaid information 
handled over the CNPC link for varying air traffic loads 

- Varied air-traffic scenarios for mixed operations 

- Evaluate for performance, safety, reliability 


NAS-Wide CNPC System Simulation for Development and V&V of C2 MOPS 


Schedule Package: C.4.40 
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Gen2 Radio in Relevant Environment Flightiest 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.1.10] Gen2 
Radio in Relevant 
Environment Flight 
Test 

4/2014 

• Analyze the performance of the second 
generation C-band CNPC System 
prototype in a relevant flight 
environment 

• Results continue the development of the CNPC system 
terrestrial operation performance standards 


• Briefings, Papers, or Reports 

- UAS-Comm-4.3-025-001, CNPC Prototype Radio Development Generation 2 Flight 
Test Program Overview, Briefing, August 2014 


Schedule Package: C.1.10 
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Verify Prototype Performance - 
Preliminary C2 MOPS Input 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.1.20] Verify 
Prototype 

Performance - Draft 
C2 MOPS Input 

1/2015 

• Analyze the performance of the fourth 
generation C-band Control and Non- 
Payload Communication System 
prototype in a relevant flight 
environment 

• Results inform: 

• Performance of CNPC System prototype in a Relevant, 
mixed traffic environment 

• Development of a final, verified and validated, 
Command and Control Minimum Operational 
Performance Standards 


• Briefings, Papers, or Reports 


Schedule Package: C.1.20 
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Verify Prototype Performance - Final C2 MOPS Input 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.1.30] Verify 
Prototype 
Performance - Final 
C2 MOPS Input 

6/2015 

(FT3) 

2/2016 

(FT4) 

• Analyze the performance of fourth 
generation Control and Non-Payload 
Communication System prototypes used 
for control and non-payload 
communication for a GCS implementing 
SAA algorithms and information display 
requirements controlling an unmanned 
aircraft surrogate operating in a mixed 
traffic environment 

• Results inform: 

• Performance of CNPC System prototype in a Relevant, 
mixed traffic environment 

• Development of a final, verified and validated, 
Command and Control Minimum Operational 
Performance Standards 


• Briefings, Papers, or Reports 


- Compliance ITU-R Prototype Comm System: Report on Results from FT3 
Simulation planned for November 2015 (FT3) 

- Compliance ITU-R Prototype Comm System: Final Report on Flight Test 4 (FY15) 
mixed traffic environment with 2nd vehicle planned for September 2016 


Schedule Package: C.1.30 
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Develop and Test Security Prototype 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.2.10] Develop 
and Test Prototype 

3/2014 

• Define CNPC security recommendations 
for civil UAS operations based on 
analysis of laboratory test results 

• Results inform understanding of CNPC system security 
architecture performance 


• Briefings, Papers, or Reports 


- UAS-Comm-4.3-015-001, Security Test Plan for Lab Prototype, January 2014 

- UAS-Comm-4.3-023-001, Control and Non-Payload Communications (CNPC) 
Prototype Radio - Generation 2 Flight Lab Security Test, Report, August 2014 

- UAS-Comm-4.3-026-001, CNPC Security Architecture Prototype, Briefing, August 
2014 


Schedule Package: C.2.10 
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Performance Validation of Security Mitigations - Relevant 
Flight Environment 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.2.20] 
Performance 
Validation of 
Security Mitigations 
- Relevant Flight 
Environment 

10/2014 

• Determine CNPC security 
recommendations for civil UAS 
operations based on analysis of flight 
test results 

• Results: 

• Inform CNPC system security design requirements 

• Inform control and non-payload security architecture 
performance 

• Contribute to validation of security mechanisms 
designed to mitigate risks and vulnerabilities of CNPC 
system as incorporated in performance standards 

• Inform understanding of CNPC system performance 
during hand-off between communication system 
ground stations and edge of coverage events 


• Briefings, Papers, or Reports 


Schedule Package: C.2.20 
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Spectrum Compatibility Analysis 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.3.10] 
Spectrum 
Compatibility 
Analysis 

Not 

applicable 

• Develop data and rationale to obtain 
appropriate frequency spectrum 
allocations to enable the safe and 
efficient operation of UAS in the NAS 

• Analysis: 

• Provides technical data on NASA UAS terrestrial CNPC 
developments to ICAO Aeronautical Communications 
Panel Working Group F to develop the technical 
parameters of the UAS LOS CNPC allocations and 
support international standards development 

• Provides compatibility studies, in coordination with 
RTCA SC-228, to evaluate technical issues involved 
with the sharing of FSS spectrum for BLOS UAS CNPC 

• Informs technical parameters for allocated UAS 
terrestrial spectrum, in International standards 
organizations 


• Briefings, Papers, or Reports 

- UAS-Comm-4.3-024-001, GRC Spectrum Update, Briefing (SC-228), August 2014 

- UAS CNPC Spectrum Final Report and Recommendations planned for September 
2016 


Schedule Package: C.3.10 
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C-Band Planning & Standards 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.3.20] C-Band 
Planning & 
Standards 

Not 

Applicable 

• Develop data and rationale to define 
usage of terrestrial spectrum for UAS 
CNPC systems to enable the safe and 
efficient operation of UAS in the NAS 

• Results inform: 

• Technical parameters for allocated UAS terrestrial 
spectrum, in International standards organizations 

• Development of C-Band band plans and standards, in 
coordination with RTCA SC-228 and delivered to ICAO 
Working Group F, to define usage of terrestrial 
spectrum for UAS CNPC systems 


• Briefings, Papers, or Reports 

- UAS-Comm-4.3-016-001, Spectrum Element C-Band Planning and Standards Dev 
Plan, Paper, January 2014 

- C-Band Planning and Standards briefing to SC-228 planned for February 2016 

- C-Band Planning & Standards Final report planned for September 2016 


Schedule Package: C.3.20 
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Flight Test Radio Model Development and Regional Sims 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.4.10] Flight 
Test Radio Model 
Development and 
Regional Sims 

5/2015 

• Develop validated radio models, based 
on flight testing and development of 
performance profiles to be used during 
regional large scale simulations 

• Results inform: 

• Initial validation of proposed RTCA CNPC performance 
standards and to recommend necessary modifications 
prior to published C2 MOPS 


• Briefings, Papers, or Reports 

- Flight Test Radio Model Development and Regional Sims Report planned for 
July2016 


Schedule Package: C.4.10 
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Recommendations for Integration of CNPC 

and ATC Comm 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.4.30] 
Recommendations 
for Integration of 
CNPC and ATC 
Comm 

Multiple 

• Develop inputs to preliminary and final 
SC-228 C2 WG MOPS based on 
simulations conducted in OPNET and 
ACES Large-scale environments using 
specific MOPS and NAS Comm 
Architecture operations scenarios 

• Results inform: 

• Communication system performance and NAS-wide 
impact from large-scale NAS simulations 
incorporating UAS communication system and vehicle 
performance characteristics 

• Validation of proposed RTCA CNPC performance 
standards prior to published MOPS 

• Recommendations for the integration of CNPC and 
ATC Comm 


• Briefings, Papers, or Reports 

- Large Scale Sims to SC-228 for C2 Final MOPS draft report planned for June 2016 

- Recommendations for Integration of CNPC and ATC Comm report planned for 
September 2016 


Schedule Package: C.4.30 
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Communication System Performance Impact Testing 

(Delays/Capacity) 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.4.40] 
Communication 
System Performance 
Impact Testing 
(Delays/Capacity) 

8/2015 

• Perform large-scale NAS simulations to 
assess impact of UAS on the NAS 
communications operations with 
different operating concepts and for 
different control and non-payload 
communication system architectures 

• Results inform: 

• ATC and CNPC Communications Performance Impact 
on NASA Delays/Capacity 


• Briefings, Papers, or Reports 

- ATC and CNPC Comm Performance Impact on NAS Delay/Capacity report planned 
for February 2016 


Schedule Package: C.4.40 
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SatCom Simulations 



TC-C2 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP C.4.50] SatCom 
Simulations 

2/2016 

• Analyze SatCom Control and Non- 
Payload Communication system using 
regional large scale simulations 

• Results inform: 

• Satcom assumptions utilized in SC-228 C2 terrestrial 
MOPS and provides initial inputs to draft SC-228 C2 
Satcom MOPS 


• Briefings, Papers, or Reports 

- SatCom for UAS Sim Report plannned for September 2016 


Schedule Package: C.4.50 
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Green Status Line Date 9/30/15 
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Surveillance Requirements (Medium Fidelity) 

(ACES Simulation) 


• Research Objective: 

- Analyze the performance of updated sensor (ADS-B, TCAS, and radar) range and fields of regard requirements and 
sensitivities against Draft MOPS Alerting requirements 

- Assess airborne radar intruder detection frequency against realistic NAS traffic (IFR, cooperative VFR, and non- 
cooperative VFR) to inform radar tracker requirements 




Preliminary: 




3 . 

E 


10 15 20 25 30 35 40 45 50 

Number of Non-Cooperalive VFR Intruders 


* Interim Results, Conclusions, and Recommendations 

- 5-nm range appears to cover 99% of potential warning alerts DAA system would encounter with non- 
cooperative VFR providing verification that 5-nmdeclaration range for airborne radar is suitable 
(Preliminary Result) 

- When UAS had at least one non-cooperative VFR intruder in its field of regard, there were 3 or fewer non- 
cooperative aircraft 98% of the time (Preliminary Result) 


Non-Cooperative Sensor Surveillance Requirements for DAA MOPS 


Schedule Package: S.1.20 
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IHITL Participation & Data Collection 


• Research Objective: 

- Test Setup 1: Evaluate air traffic controller acceptability of UAS maneuvers in response to SAA advisories and pilot 
performance for remaining Well Clear 

- Test Setup 2: Evaluate the pilot's ability to remain well clear as a function of detect-and-avoid display features and 
whether the display was stand-alone or integrated within the main traffic display 





• Results, Conclusions, and Recommendations: 

- Test Setup 1 

• Controllers reported maneuvers requested between 60 and 90 seconds until closest point of approach were acceptable, and at 
120 seconds were unacceptable. 

• Size of requested maneuvers was frequently judge to be too large, indicating a difference between the separation standard 
used by UAS pilots to remain Well Clear and manned aircraft. 

- Test Setup 2 

• Maneuver recommendations appear to be the 'Advanced' feature most effective in remaining Well Clear 

• Although non-cooperative aircraft can only be detected at a limited range, most losses of Well Clear can be prevented given 
alert time of at least 60 seconds to closet point of approach 

• Pilot response time results will help improve fidelity (ATC/UAS pilot interactions) of non-real-time-time simulations 


ATC Interoperability Requirements for DAA MOPS 


Schedule Package: S.2.20 
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Self-Separation Risk Ratio Study 


• Research Objective: 

- Estimate the achievable DAA self separation risk ratio under simplifying assumptions on pilot response 
and surveillance capabilities. 

- To identify necessary capabilities improvements for assessing draft MOPS requirements in future studies. 





Total Response Time Aircraft Well Clear 

From alert appearance until Maneuvers Threshold 
final edit/maneuver 
uploaded to GCS 


Run # 

SST time to LoWC 
(sec) 

LoWC Prediction HMD/DMOD 
(incl. buffer) (ft.) 

HMD Resolution Buffer 

1 

40s 

4000 ft. 

10% 

2 

70s 

4000 ft. 

10% 

3 

40s 

5000 ft. 

10% 

4 

70s 

5000 ft. 

10% 

5 

40s 

4000 ft. 

20% 

6 

70s 

4000 ft. 

20% 

7 

40s 

5000 ft. 

20% 

8 

70s 

5000 ft. 

20% 


* Results, Conclusions, and Recommendations: 

- Resolution horizontal miss distance buffer had negligible impact on Risk Ratio (may need larger buffers) 

- Increasing self-separation threshold demonstrated greatest Risk Ratio reduction : Highlights importance of 
pilot response modeling to DAA risk ratio estimation 

- Increasing predicted HMD/DMOD showed modest risk ratio reduction: poor risk ratios for no buffer case 
(4,000 feet prediction HMD/DMOD)... points to importance of prediction buffers 


Self-Separation System Performance Requirements for DAA MOPS 


Schedule Package: S.2.30 
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SSI-ARC FT3 Participation & Data Collection 


• Research Objective: 

- Gather data on the performance of a SAA concept with flight representative trajectory uncertainties, 
control and non-payload communication system characteristics, vehicle dynamics, and SAA sensors in 
order to improve and calibrate simulation models 






AFRC Ikhana 


Live Intruder 

• ADS-B 

• TCAS II Instm 

• High speed 



• Results, Conclusions, and Recommendations: 

- Test complete 

- Data analysis is on-going 


Self-Separation System Performance Requirements for DAA MOPS 


Schedule Package: S.2.40 
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SAA Traffic Display Evaluation HITL2 
(joint w/HSI Part Task Sim 5) 



• Research Objective: 

- Build upon previous human-in-the-loop simulations results and lessons learned to identify minimum DAA display 
and guidance requirements for draft SC228 MOPS 

- Evaluate pilot's ability to remain well clear when considering sensor uncertainty, Preliminary MOPS alerting 
structure, and DAA guidance mode (informative vs. suggestive) 
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* Results, Conclusions, and Recommendations: 

- Info Only (19.8%) was roughly four times as likely as Stratway+ (6.5%) and Omni Bands (4.2%) to result in 
Loss of Well Clear, a significant difference (p<. 05) 

- No significant differences seen between the three guidance displays in terms of Loss of Well Clear 

- Pilots responded, on average, 10 seconds faster to Self Separation Warning Alerts than they did to 
Corrective Self Separation Alerts 

- Positive subjective feedback from pilots on Preliminary MOPS Alerting methodology 


Self-Separation Sensor Performance Requirements for DAA MOPS 


Schedule Package: S.2.60 
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DAA Self-Separation Alerting Methods, Performance, and 
Robustness Study (ACES Simulation) 

• Research Objective: 

- Gather data to support development of alerting logic, methods, and performance requirements using 
cooperative and non-cooperative VFR traffic and the SC-228 definition of Well Clear considering target 
level of safety and NAS-interoperability 





* Interim Results, Conclusions, and Recommendations: 

- Correct SS Warning Alerts alerts have at least 15 seconds of lead time to LOWC in 83% of cases 

- 72% of Warning alerts resulted in a loss of well clear suggest alerting criteria is within suitable 
performance bounds 

- Even though the probability of false alert for Corrective alerts seem high, most of the encounter fall within 
the vertical or horizontal bounds of the well clear definition, which indicates a low severity level (most 
false alerts would be acceptable from a safety stand-point to overcome missed alerts) 


Self-Separation Alerting Requirements for DAA MOPS 


Schedule Package: S.3.30 
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UASCAS1 HITL 


• Research Objective: 

- Evaluate the impact of UAS SAA self separation maneuvers resulting for different SAA Well Clear volumes 
on controller perceptions of safety and efficiency 




CV, CAT, s$y. SST and “Wall Claar" 



Workshop Model with NASA SAA Concept s Sert-Seperabon Volume 

<SSV) 



CofltMon AvoKJarice ThftshoW l CAT) 
Setf-Saperabon Volume <SSV| 


S«tf Separation Threshold (SST) 

Note CAT SSV and SST boundaries are noftonei and ganaraly not eyhndneai 



SAA "Self Separation Bands” Concept 



for Opposite Direction encounters 
14 ATC subjects for each encounter 
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* Results, Conclusions, and Recommendations: 

- A horizontal miss distance of ~1.5 nm appears to be optimal for ATC acceptability (away from the airport 
vicinity) 

- Horizontal miss distance of 1.5 nm is 150% larger than the TCAS resolution advisory horizontal miss 
distance for all airspace below Class A, and 136% larger in Class A 

- 500' IFR-VFR vertical separation (with no vertical closure rate) was universally acceptable during debrief 
sessions 

- Air traffic controllers thought the SAA integration concept as presented was viable 


Well Clear Separation & ATC Interoperability Requirements for DAA MOPS 


Schedule Package: S.5.10 
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SSI-LaRC Support & Participation in IHITL 


• Research Objective: 

- Assess SAA-to-Traffic Alert and Collision Avoidance System interoperability and the impact of CNPC system 
delay on the execution of UAS pilot Self Separation tasks 





* Interim Results, Conclusions, and Recommendations: 

- Simulation shows to maintain Well Clear and avoid almost all TCAS Resolution Advisories: 

• Above 10,000 feet with typical airliner speeds - need at least 1.5 nm Closet Point of Approach 

• Below 10,000 feet below 250 knots, need at least 1.2 nm Closet Point of Approach 


DAA-TCAS & ATC Interoperability Requirements for DAA MOPS 


Schedule Package: S.5.20 
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SSI LaRC Support & Participation in FT3 


• Research Objectives: 

— Evaluate the performance of self separation Stratway+ algorithm using a cooperative sensor in constrained 
geometric/operational conditions in the presence of real winds (Min Success) 

— Evaluate the performance of General Atomics Conflict Prediction and Display System vs. Stratway+ coordination of 
maneuver guidance and the performance of a self separation algorithm using both cooperative and non- 
cooperative sensors in the presence of real winds (Full Success) 





* Interim Results, Conclusions, and Recommendations: 

- Testing successfully accomplished in July 2015 

- Analysis in progress 


Self-Separation System Performance Requirements for DAA MOPS 


Schedule Package: S.5.40 
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Alerting Times + Collision Avoidance-Self Separation 
Integration Combined HITL 

• Research Objective: 

- Develop and evaluate a concept of integrated Collision Avoidance and Safe Separation functions that 
enables UAS to execute automated maneuvers in terms of acceptability to ATC, as well as investigate the 
range of acceptable times to alert the UAS pilot to potential loss of well-clear condition 





* Interim Results, Conclusions, and Recommendations: 

- Testing successfully completed September 15, 2015 

- Analysis in progress 


Automated Self-Separation Maneuver Requirements for DAA MOPS 


Schedule Package: S.5.60 
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Surveillance Requirements (Medium Fidelity) 
_ (ACES Simulation) 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SPS.1.10] 
Surveillance 
Requirements (Low 
Fidelity) (ACES 
Simulation) 

2/2014 

• Analyze tradeoffs in the performance of 
different surveillance ranges and fields 
of regard using perfect sensor and 
unmitigated (without Autoresolver) SAA 
encounters 

• Examine the impact on an aircrafts' 
ability to remain "Well Clear" or avoid 
the Near Mid-Air Collision volume 
without a mitigation strategy (self 
separation algorithm) 

• Results inform: 

• SAA surveillance system performance requirements 
for multiple self-separation and collision avoidance 
concepts/capabilities functional requirements 

• The performance characteristics of and interactions 
between SAA system functions 

• SAA algorithm development 


• Briefings, Papers, or Reports 

— Surveillance Requirements (Medium Fidelity) Brief results to SC-228 planned for 
October 2015 


Schedule Package: S.1.20 
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SAA Traffic Display Evaluation HITL1 
(joint w/HSI Part Task Sim 4) 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.2.10] SAA 
Traffic Display 
Evaluation HITL1 
(joint w/HSI Part 
Task Sim 4) 

2/2014 

• Evaluate integrated SAA system under 
perfect sensor conditions 

• Evaluate the pilot's ability to remain 
clear as a function of self separation 
threshold 

• Evaluate the pilot's acceptability of 
recommended Autoresolver maneuvers 
to avoid well-clear 

• Evaluate the utility of two different trial 
planner capabilities that aid an UAS in 
remaining well-clear of other traffic 

• Results: 

• Inform SAA system display requirements to include 
trial planning capabilities 

• Contribute to defining performance characteristics for 
UAS human-automation systems 

• Provide estimates for the impact of UAS (pilot, traffic 
displays, SAA algorithm/concept/displays) operations 
on NAS safety over a range of UAS mission profiles 

• Provide estimates for number of Well Clear violations, 
pilot acceptability of autoresolver SAA maneuvers, 
pilot acceptability of alerting criteria, encounter 
characteristics if/when autoresolver fails to 
recommend a Well Clear maneuver, and Well Clear 
maneuver characteristics, pilot/air traffic controller 
negotiation times 


• Briefings, Papers, or Reports 


- UAS-SSI-4. 1-033-001, PT4 Detect and Avoid Results Presentation, Briefing (SC-228), 
August 26 2014 

- UAS-SSI-4. 1-048-001, Pilot Evaluation of a UAS Detect-and-Avoid System's 
Effectiveness in Remaining Well Clear, Paper, June 2015 


Schedule Package: S.2.10 
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IHITL Participation & Data Collection 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.2.20] IHITL 
Participation & Data 
Collection 

6/2014 

• Evaluate air traffic controller 
acceptability of UAS maneuvers in 
response to SAA advisories and pilot 
performance for remaining "Well Clear" 

• Results inform and support understanding of: 

• Air traffic controller acceptability of UAS maneuvers in response 
to SAA advisories 

• UAS pilot's performance at remaining Well Clear modeling non- 
cooperative sensor range, elevation, and azimuth performance 
as part of an SAA system 

• Existing air traffic control procedures and operations in the 
presence of a UAS 

• Interoperability between UAS pilot and air traffic controller 

• Sensor performance on UAS pilot's ability to perform SAA 
functions and maintain Well Clear 

• Impact of realistic estimate of CNPC system latency impact on 
UAS pilot and air traffic controller operations and performance 

• Well Clear as a airborne separation standard for UAS 

• Air traffic controller ability to recognize/correct a Well Clear 
violation 

• UAS pilot workload 


• Briefings, Papers, or Reports 

- UAS-SSI-4. 1-044-001, UAS-NAS, IHITL, Pilot Detect-and-Avoid Evaluation, Briefing (SC- 
228), November 2014 

- UAS-SSI-4. 1-045-001, Airspace Concept Evaluation System (ACES) Simulation Study, 
Briefing (SC-228), November 2014 

- UAS-SSI-4. 1-048-001, Pilot Evaluation of a UAS Detect-and-Avoid System's Effectiveness 
in Remaining Well Clear, Paper, June 2015 


Schedule Package: S.2.20 
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Self-Separation Risk Ratio Study 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.2.30] Self- 
Separation Risk 
Ratio Study 

4/2014 

• Gather data indicating the degree to 
which self separation systems mitigate 
the probability that an encounter to the 
self separation threshold will proceed to 
a Well Clear violation (self separation 
Airspace Safety Threshold) 

• Results: 

• Inform the understanding of the level of UAS safety a self- 
separation system could achieve in the NAS with multiple UAS 
mission profiles and NAS traffic estimates using perfect 
surveillance state information of cooperative VFR traffic 

• Provide estimates of risk ratio as a function of self-separation 
threshold and Well Clear definition, number/rate of UAS-to-VFR 
conflicts to the self-separation threshold, number/rate of 
conflicts that progress to Well Clear violations, secondary 
encounters with other aircraft following execution of a self 
separation maneuver, deviation magnitude from flight plan, 
number of TCAS RAs generated 

• Inform understanding of allowable tradeoffs between SAA 
system functions 

• Inform UAS performance based rules for SAA equipage 

• Contribute to air traffic control operating procedures for UAS 
SAA systems 


• Briefings, Papers, or Reports 

- UAS-SSI-4. 1-037-001, Final Overview of ACES Sim for Evaluating SARP Well Clear Definitions, Briefing (SARP), August 5 2014 

- UAS-SSI-4. 1-039-001, ACES Mitigated Results Supporting Selection of SARP Well-Clear Definition Maneuver Initiation Point MIP, 
Briefing (SC-228), August 7 2014 

- UAS-SSI-4.1-040-001, ACES Unmitigated and some Mitigated Results Supporting Selection of SARP Well Clear Definition, Briefing (SC- 
228), August 5 2014 

- UAS-SSI-4. 1-042-001, Encounter Rate Simulation Study with UAS Missions, Briefing, September 2014 

- UAS-SSI-4. 1-060-001, Airspace Safety Threshold Study- NAS-wide Encounter Rate Evaluation using Historical Radar Data and ACES, 
Briefing, May 2015 


Schedule Package: S.2.30 
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SSI-ARC FT3 Participation & Data Collection 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.2.40] FT3 
Participation & Data 
Collection 

6/2015 

• Gather data on the performance of a 
SAA concept with flight representative 
trajectory uncertainties, control and 
non-payload communication system 
characteristics, vehicle dynamics, and 
SAA sensors in order to improve and 
calibrate simulation models 

• Results used to calibrate models with flight test data 
(Communication system models, UAS performance 
models, sensor models, trajectory performance models) 

• Results inform DAA MOPS 


• Briefings, Papers, or Reports 

- FT3 Participation & Data Collection SSI ARC FT3 brief results to SC-228 planned for 
January 2016 

- FT3 Participation & Data Collection SSI ARC FT3 report/paper planned for January 2016 


Schedule Package: S.2.40 
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SSI-ARC FT4 Participation & Data Collection 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.2.50] FT4 
Participation & Data 
Collection 

2/2016 

• Determine the performance of a SAA 
concept 

• Gather data for additional validation of 
simulation models and results with flight 
representative trajectory uncertainties, 
control and non-payload communication 
system characteristics, vehicle dynamics, 
and SAA sensors 

• Results inform: 

• DAAMOPS 

• Accuracy of ACES simulation results 


• Briefings, Papers, or Reports 

- FT4 Participation & Data Collection SSI ARC FT4 brief results to SC-228 planned for June 
2016 

- FT4 Participation & Data Collection SSI ARC FT4 report/paper planned for June 2016 


Schedule Package: S.2.50 
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SAA Traffic Display Evaluation HITL2 
(joint w/HSI Part Task Sim 5) 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.2.60] SAA 
Traffic Display 
Evaluation HITL2 
(joint w/HSI Part 
Task Sim 5) 

2/2015 

• Evaluate the pilot's ability to remain 
clear of other traffic with different 
sensor range and field of regard 
limitations, and sensor uncertainties 

• Results inform: 

• Pilot's acceptability of Autoresolver resolutions and 
trial planning capability 

• And support the development of SAA system 
requirements and performance standards (MOPS) 


• Briefings, Papers, or Reports 

- SAA Traffic Display Evaluation HITL2 brief results to SC-228 planned for May 2015 

— SAA Traffic Display Evaluation HITL2 Results Simulation report planned for September 
2015 


Schedule Package: S.2.60 
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Effect of SAA Maneuvers with Procedures 

(ACES Simulation) 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.2.70] Effect of 
SAA Maneuvers with 
Procedures (ACES 
Simulation) 

4/2015 

• Gather data indicating the degree to 
which Self Separation systems mitigate 
the probability that an encounter to the 
Self Separation threshold will proceed to 
a well clear violation (Self Separation 
Airspace Safety Threshold), using higher 
fidelity models of sensor uncertainties, 
communications latencies and pilot- 
controller interactions 

• Results inform: 

• risk ratio for self-separation systems with imperfect 
surveillance state information and realistic pilot- 
controller negotiation times against cooperative and 
non-cooperative VFR traffic 

• And support the development of SAA system 
requirements and performance standards (MOPS) 


• Briefings, Papers, or Reports 

- UAS-SSI-4. 1-049-001, UAS DAA SS Risk Ratio Study AKA Effect of SAA Maneuvers with 
Procedures Experiment Design Review - Not for Public Release, Brief, September 2014 

- ACES Simulation Report planned for December 2015 


Schedule Package: S.2.70 
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Comprehensive Evaluation of Airspace Risk Threshold 

(ACES Simulation) 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.2.80] 
Comprehensive 
Evaluation of 
Airspace Risk 
Threshold (ACES 
Simulation) 

2/2016 

• Gather data indicating the degree to 
which Self Separation systems mitigate 
the probability that an encounter to the 
Self Separation threshold will proceed to 
a well clear violation, using higher 
fidelity models of sensor uncertainties, 
communications latencies and pilot- 
controller interactions that have been 
validated by flight test data 

• Results inform: 

• Fast-time simulation results, validated by flight tests, 
indicating which combinations of SAA system 
parameters would allow UAS operations to meet the 
airspace risk threshold 

• AutoResolver (as a proxy for pilot-in-the-loop self- 
separation system) ability to mitigate well clear 
violations relative to the SST encounter rate 

• The combinations of SAA system parameters (e.g. 
allowable latency, surveillance range) that allows UAS 
operations to meet the airspace risk threshold 

• and support the development of SAA system 
requirements and performance standards (MOPS) 


• Briefings, Papers, or Reports 

- Comprehensive Evaluation of Airspace Risk Threshold SSI ARC Brief results to SC-228 
planned for July2016 

- ACES Simulation Report planned for August 2016 


Schedule Package: S.2.80 
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Well Clear Metric and Definition Study 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.3.10] Well 
Clear Metric and 
Definition Study 

4/2014 

• Gather data and develop 

recommendations for a quantified 
definition of "Well Clear" using 
cooperative Visual Flight Rule traffic that 
meets target level of safety 
requirements and NAS-interoperability 
considerations 

• Results: 

• Inform the development of a quantified Well Clear 
definition and SAA concept with multiple UAS mission 
profiles and NAS traffic estimates using perfect 
surveillance state information of cooperative VFR 
traffic 

• Contribute to the definition of Well Clear time and/or 
distance dimensions 

• Generate Well Clear maneuver resolution 
characteristics for UAS and cooperative VFR traffic for 
multiple definitions of Well Clear 

• Provide estimates for risk ratio as a function of self- 
separation threshold and Well Clear definition, 
number/rate of Well Clear violation, number/rate of 
NMAC, number of generated TCAS RAs, number/rate 
of UAS-to-VFR traffic conflicts to the self-separation 
threshold 


• Briefings, Papers, or Reports 


— UAS-SSI-4. 1-026-001, Investigating Effects of Well Clear Definitions on UAS SAA Operations Slides, 
Briefing, Plan, May 2014 

- UAS-SSI-4. 1-046-001, Investigating the Impacts of a Separation Standard for UAS Enroute and 
Transition Airspace, Paper, November 2014 


Schedule Package: S.3.10 
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DAA Self-Separation Alerting Methods, Performance, and 
Robustness Study (ACES Simulation) 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.3.30] DAA Self- 
Separation Alerting 
Methods, 
Performance, and 
Robustness Study 
(ACES Simulation) 

3/2015 
(Phase 1) 

7/2015 
(Phase 2) 

• Gather data to support development of 
alerting logic, methods, and 
performance requirements using 
cooperative and non-cooperative VFR 
traffic and the SC-228 definition of Well 
Clear considering target level of safety 
and NAS-interoperability 

• Results inform: 

• Fast-time simulation results for a SAA concept 
incorporating well clear alerting logic with perfect 
surveillance state information against cooperative and 
non-cooperative VFR traffic 

• Alerting logic methods and performance 

• Selection of a particular SAA concept of operations 
using the fast time simulation results 


• Briefings, Papers, or Reports 

- UAS-SSI-4.1-050-001, UAS DAA Alerting Studies and ACES Fast Time Simulation - Not for Public Release, Brief, 
February 2015 

- UAS-SSI-4.1-061-001, Analysis of Baseline PT5 Alerting Scheme in Fast-Time Simulations without DAA Mitigation, 
Briefing, May 2015 

- Phase 2 - Document results in final report/briefing planned for December 2015 


Schedule Package: S.3.30 
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Collision Avoidance/Self Separation Algorithm Maneuvers 

vs. UA Performance Assessment 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.4.20] Collision 

Avoidance/Self 

Separation 

Algorithm 

Maneuvers vs. UA 

Performance 

Assessment 

2/2016 

• Generate performance data for the 
trade-off space between UAS and DAA 
algorithm performance 

• Results inform: 

• Maneuver time requirements for a spanning set of 
aircraft performance models over a broad range of 
encounters for selected algorithms 

• DAA requirements 

• DAA MOPS 


• Briefings, Papers, or Reports 


— Collision Avoidance/Self Separation Algorithm Maneuvers vs. UA Performance 
Assessment Preliminary Results for Stakeholders Available July2016 

- Collision Avoidance/Self Separation Algorithm Maneuvers vs. UA Performance 
Assessment Results Paper planned for August 2016 


Schedule Package: S.4.20 
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UAS CAS1 HITL 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.5.10] UAS 
CAS1 HITL 

1/2014 

• Evaluate the impact of UAS SAA self 
separation maneuvers resulting for 
different SAA Well Clear volumes on 
controller perceptions of safety and 
efficiency 

• Results inform: 

• Understanding of air traffic controller operational 
acceptability of UAS Stratway+ self-separation 
concept/capability 

• Understanding of air traffic controller operational 
acceptability of quantifying the definition of Well 
Clear 

• Understanding of air traffic controller workload in the 
presence of a UAS with Stratway+ self-separation 
concept/capability operating in the NAS 

• Understanding of interoperability of UAS Stratway+ 
self-separation concept/capability and TCAS II 


• Briefings, Papers, or Reports 


- UAS-SSI-4. 1-016-001, UAS Controller Acceptability Study 1 (UAS-CAS1) Test Plan, November 2013 

- UAS-SSI-4. 1-019-001, UAS-CAS1 FER Slides, Briefing, November 2013 

- UAS-SSI-4. 1-021-001, UAS CAS1, Briefing (AUVSI), May 2014 

- UAS-SSI-4. 1-031-001, UAS-CAS1, Briefing (SC-228), May 2014 

- UAS-SSI-4. 1-051-001, UAS in the NAS Air Traffic Controller Acceptability Study - 1 the Effects of 
Horizontal Miss Distances on Simulated UAS and Manned Aircraft Encounters, Briefing, May 2015 

- UAS-SSI-4. 1-052-001, UAS in the NAS Air Traffic Controller Acceptability Study - 1 the Effects of 
Horizontal Miss Distances on Simulated UAS and Manned Aircraft Encounters, Paper, May 2015 


Schedule Package: S.5.10 
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SSI-LaRC Support & Participation in IHITL 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.5.20] Langley 
Support & 

Participation in IHITL 

6/2014 

• Assess SAA-to-Traffic Alert and Collision 
Avoidance System interoperability and 
the impact of CNPC system delay on the 
execution of UAS pilot self separation 
tasks 

• Results inform and support understanding of: 

• Air traffic controller acceptability of UAS maneuvers 
in response to SAA maneuvers 

• Compatibility of the Stratway+ SAA concept (and Well 
Clear criteria implementation) with existing TCAS II 
equipped aircraft 

• Impact of CNPC system latencies on UAS pilot and air 
traffic controller operations and performance 

• Impact of wind direction and velocity on UAS pilot 
and air traffic controller operations and performance 

• Interoperability of SAA concept with TCAS equipped 
aircraft Collision Avoidance Volumes 


• Briefings, Papers, or Reports 

- UAS-SSI-4. 1-022-001, UAS Controller Acceptability Study 2 (UAS-CAS2) and IHITL Test Plan, May 2014 

- UAS-SSI-4. 1-023-001, UAS-CAS2 IHITL (PER-FER), Briefing, May 2014 


- UAS-SSI-4. 1-024-001, IHITL Experiment Plan-Controller Subjects (aka Configuration 1, test setup 1), 
Briefing, May 2014 

- UAS-SSI-4. 1-043-001, Completed, Ongoing and Upcoming Experiments iHITL-B747-TCAS and IHITL-CAS2 
Overview and Results, Briefing (SC-228), November 2014 

- UAS-SSI-4. 1-053-001, UAS Air Traffic Controller Acceptability Study 2 - Effects of Communications Delays 
and Winds in Simulation, Paper, May 2015 


Schedule Package: S.5.20 
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SSI LaRC Support & Participation in FT3 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.5.40] SSI LaRC 

6/2015 

• Evaluate the performance of self 

• Results inform: 

Support & 


separation Stratway+ algorithm using a 

• Performance of self separation-Stratway+ algorithm 

Participation in FT3 


cooperative sensor in constrained 
geometric/operational conditions in the 
presence of real winds (Min Success) 

• Evaluate the performance of General 
Atomics Conflict Prediction and Display 
System vs. Stratway+ coordination of 
maneuver guidance and the 
performance of a self separation 
algorithm using both cooperative and 
non-cooperative sensors in the presence 
of real winds (Full Success) 

using a cooperative sensor in constrained 
geometric/operational conditions in the presence of 
real winds (min success). 

• Performance of CPDS vs. Stratway+ coordination of 
maneuver guidance, and performance of a self 
separation algorithm (CPDS on Ikhana) using both 
cooperative and non-cooperative sensors, in the 
presence of real winds (full success) 

• DAA requirements 

• DAA MOPS 


• Briefings, Papers, or Reports 

- SSI LaRC Support & Participation in FT3 Brief Results to SC-228 planned for January 
2016 

- SSI LaRC FT3 report/paper planned for February 2016 


Schedule Package: S.5.40 
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SSI LaRC Support & Participation in FT4 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.5.50] SSI LaRC 
Support & 
Participation in FT4 

2/2016 

• Evaluate the performance of self 
separation Stratway+ algorithm in 
constrained geometric/operational 
conditions in the presence of real winds 
for both cooperative and non- 
cooperative targets utilizing a fast (~250 
knots) surrogate UAS with a full DAA 
sensor suite and fusion/tracker 
capability (min success) 

• Evaluate the performance of a self 
separation algorithm in constrained 
geometric/operational conditions in the 
presence of real winds and a suite of 
sensors for both cooperative and non- 
cooperative targets utilizing a live UAS as 
part of the flight scenarios (full success) 

• Results inform: 

• SAA system performance with fast (~250 knots) 
surrogate UAS equipped with CNPC, a full suite of 
sensors for cooperative and non-cooperative targets 
with guidance provided by Stratway+/RGCS (min 
success) 

• SAA system performance from Ikhana (or alternate, 
equivalent UAS capability) equipped with CNPC, a full 
suite of sensors for cooperative and non-cooperative 
targets with guidance provided by CPDS (or 
equivalent DAA algorithm capability such as 
Stratway+) (full success) 

• DAA requirements 

• DAA MOPS 


• Briefings, Papers, or Reports 

- SSI LaRC Support & Participation in FT4 Brief Results to SC-228 planned for July 2016 

- SSI LaRC FT4 report/paper planned for August 2016 


Schedule Package: S.5.50 
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Alerting Times + Collision Avoidance-Self Separation 

Integration Combined HITL 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.5.60] Alerting 
Times + Collision 
Avoidance-Self 
Separation 
Integration 
Combined HITL 

5/2015 

• Develop and evaluate a concept of 
integrated Collision Avoidance and Safe 
Separation functions that enables UAS 
to execute automated maneuvers in 
terms of acceptability to ATC, as well as 
investigate the range of acceptable 
times to alert the UAS pilot to potential 
loss of well-clear condition 

• Results inform: 

• Declaration times: what are excessive, leading to 
nuisance alerts for controllers and UA pilots and what 
times are too short and provide insufficient time to 
query/negotiate maneuvers with ATC and execute 
them before triggering TCAS RAs. 

• The feasibility of the integration of elf separation and 
collision avoidance functions as part of a complete 
SAA capability 


• Briefings, Papers, or Reports 

- UAS-SSI-4. 1-059-001, UAS CAS 3 CASSAT PER/FER, Briefing Plan, March 2015 

- Alerting Times + Collision Avoidance-Self Separation Integration Combined HITL 
Brief results to SC-228 planned for February 2016 

- HITL Results Paper planned for March 2016 


Schedule Package: S.5.60 


125 



GA-FAA (SAA Initial Flight Tests) Flight Test Participation 
w/IT&E 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.6.10] SAA 

11/2014 

• Perform collaborative flight tests and 

• Results: 

Initial Flight Test 


demonstrations to evaluate, validate 

• Performance data from flight test will continue to 

Participation w/IT&E 


and refine simulation-tested SAA 
concepts in an actual flight environment 
with prototype airborne sensors for 
non-cooperative intruders in addition to 
ADS-B and TCAS II, as well as prototype 
ground station information displays 

support the development of the Stratway+ SAA 
concept by verifying Stratway+ self-separation 
algorithm performance in a flight test environment 

• Provide risk reduction for the IT&E subproject live, 
virtual, constructive distributed test environment 

• Inform performance Self Separation requirements 
and standards 

• Inform the development of surveillance system 
architecture requirements 


• Briefings, Papers, or Reports 

- GA-FAA (SAA Initial Flight Tests) Flight Test Participation w/IT&E Technical 
Conference Paper planned for October 2015 


Schedule Package: S.6.10 
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Sensor Model Stress Testing & Sensitivity Analysis HITL 



TC-SAA 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP S.7.10] Sensor 
Model Stress Testing 
& Sensitivity 
Analysis HITL 

2/2016 

• Evaluation of the NASA developed 
Stratway+ SAA algorithm and pilot 
interface subject to various types and 
levels of uncertainty and sensor models 
errors in a human-in-the-loop simulation 

• Results inform: 

• The performance of an integrated SAA capability (self 
separation and collision avoidance) in a HITL 
experiment with modeled sensor uncertainties and 
realistic traffic scenarios 

• DAA requirements 

• DAA MOPS 


• Briefings, Papers, or Reports 

- Sensor Model Stress Testing & Sensitivity Analysis HITL Preliminary Results for 
Stakeholders Available July2016 

- HITL Results Paper planned for August 2016 


Schedule Package: S.7.10 
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TC - SAA (1 of 2) 



IC - SAA Performance Standards 

[TWP S.1J SAA Sub-function Tradeoffs and Requirements 

[SP S. 1.10] Surveillance Requirements (Low Fidelity) (ACES Simulation) 

[S PS. 1.20] Surveillance Requirements (Medium Fidelity) (ACES Simulation) 

[5P 5.1.30] Interoperability of SS and CA Functions (ACES Simulation) 

[SP 5.1.40] Sub-function Tradeoffs w / UAS Performance (ACES Simulation) 
[TWPS.2] Interoperability and Impact of SAA- Equipped UAS on the MAS 
[SP S.2.01] ACES Software Development & Support 

[SPS.2.10] SAA Traffic Display Evaluation HITL1 (joint w/ HSI Part Task Sim 4) 

[SP S.2.20] IHITL Participation & Data Collection 
[SP S.2.30] Self-Separation Risk Ratio Study 
[SP S.2.40] FT3 Participation & Data Collection 
[SP S.2..50] FT4 Participation & Data Collection 

[SP S.2.60] SAA Traffic Display Evaluation HITL2 HITL [joint w/ HSI Part Task Sim 5) 

[SP S.2.70] Effect of SAA Maneuvers with Procedures (ACES Simulation) 

[SPS.2.S0] Comprehensive Evaluation of Airspace Risk Threshold ( ACES 
Simulation) 

[TWP S.3] Well Clear Definition and SAA Concept of Operations 
[SP 5.3.01] SC-228 Collaboration 
[SP S.3. 10] Well Clear Metric and Definition Study 

[SP S.3. 30] DAA Self-Separation Alerting Methods, Performance, and Robustness 
Study (ACES Simulation) 
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TC - SAA (2 of 2) 




[TWP S.4] SAA Performance & MOPS Development 

[SP S.4.01] Subproject Management & Overhead 

[SP 5.4.02] SC-22S DAA WG Support 

[SP S.4. 10] UAS - SAA Trade-off Assessments - Final 

[SP S.4. 20] CA/SS Algorithm Maneuvers vs. UA Performance Assessment 

[SP S.4.03] Final Product Preparation (inputs to SC-22B MGPS, NASA Reports., 
and/or Conference Papers) 

[TWP S.5] Airspace Integration & SAA Interoperability 

[5PS.5.10] UAS CAS1HITL 

[SP 5.5.20] Langley Support & Participation in IHITL 
[SP S.5. 30] Comm Gen2 Flight Test Participation & Data Collection 
[SP S.5. 40] SSI LaRCSupport & Participation in FT3 
[SP S.5. 50] SSI LaRC Support & Participation in FT4 
[SP S.5. SO] Alerting Times + CA-SS Integration Combined HITL 
[TWP S.6] CA-SS Coordination and Interoperability 

[SP S.6. 10] Partner-FAA (SAA Initial Flight Tests) Flight Test Participation w/ IT&E 

[TWP S.7] Sensor Modelling & SAA Uncertainty Impact Evaluation 

[SP S.7. 10] Sensor Model Stress Testing & Sensitivity Analysis HITL 
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HSI IHITL Participation & Data Collection 


• Research Objective: 

- Evaluate an instantiation of the prototype GCS in relevant environment 






* Interim Results, Conclusions, and Recommendations: 

- Integration of guidance and auto pilot in the auto-resolver and auto resolver + vector planner conditions 
led to significantly faster pilot 'edits' 

- No other significant differences in pilot response times 

- Rorie, R. C., & Fern, L. (2015). The impact of integrated maneuver guidance information on UAS pilots 
performing the detect and avoid task. Proceedings of Human Factors and Ergonomics Society, Los Angeles, 
CA, Oct 26-30 


GCS Information Guidelines/Requirements for DAA and C2 MOPS 


Schedule Package: H.1.10 
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Measured Response Simulation C 



• Research Objective: 

- Investigate the effects of number of UAS per sector and types of UAS on GCS information requirements 



* Results, Conclusions, and Recommendations: 

- No significant effect on number of UAS on loss of separation 

- In terms of efficiency, the time it took aircraft to travel through the sector increased with more UAS and 
increased with mixed and fast UAS, when multiple UAS were present 

- Handoff accept time decreased with increasing number of UAS, due to the reduction in conventional 
aircraft entering the sector and varied as a function of the combination of number of UAS and the speed 

- The presence of additional UAS negatively impacted Air Traffic Controller performance 


GCS Information Guidelines/Requirements for DAA and C2 MOPS 


Schedule Package: H.1.20 
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Part-task Simulation 5: SAA Pilot Guidance Follow-on 


• Research Objective: 

- Evaluate various proposed informational and directive SAA displays to determine the basic information 
requirements and advantages of advanced pilot guidance 
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* Interim Results, Conclusions, and Recommendations: 

- Suggestive guidance in the form of banding resulted in safer and more timely maneuvers away from 
conflicts 

• Fewer overall number of LoWC for both banding displays 

• Faster overall response times for both banding displays 

- Rorie, R. C., Fern, L., & Shively, J. (2016). The impact of suggestive maneuver guidance on UAS pilots 
performing the detect and avoid function. Proceedings ofAIAA Science and Technology Forum and 
Exposition 2016, San Diego, CA, Jan 4-8 


GCS Display Minimum Information Guidelines/Requirements for DAA and C2 MOPS 


Schedule Package: H.1.70 
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Visual Requirements for Landing Task 


• Research Objectives: 

- Evaluate nose camera video display requirements for manual takeoff and landing 




- Determine the minimum C2 bandwidth that still enables the safe execution of the takeoff and landing 
tasks 






Experiment Setup 


* Results, Conclusions, and Recommendations: 

- Preliminary qualitative results obtained with three pilot participants indicated that the degraded video 
resolution and frame rates affected their ability to fly a safe approach in a number of ways 

- Overall the pilots stated that the degradation in the resolution was manageable, whereas they felt 
"dangerous" with the degradation in frame rate 

- Internal Project Paper: Required Bandwidth for GCS Display(s) Supporting UAS Landing 


GCS Display Minimum Information Guidelines/Requirements for DAA and C2 MOPS 


Schedule Package: H.1.90 
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HSI IHITL Participation & Data Collection 



TC-HSI 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP H.1.10] HSI IHITL 
Participation & Data 
Collection 

5/2014 

• Evaluate an instantiation of the 

prototype GCS in relevant environment. 

• Results inform the understanding of: 

• Acceptability to the air traffic controller of UA 
maneuvers in response to SAA advisories and air 
traffic controller clearances 

• Acceptability to the air traffic controller of the 
procedures for negotiation with UAS pilots to conduct 
maneuvers to remain Well Clear 

• The performance of the UAS pilot to 
control/maneuver the UA in response to SAA alerts, 
advisories, and situational awareness information 
displayed to the 

UAS pilot 

• Acceptability to the UAS pilot of the procedures for 
negotiation with air traffic controllers to conduct 
maneuvers to remain Well Clear 


• Briefings, Papers, or Reports 


- UAS-HSI-4. 2-025-001, IHITL: DAA Display Evaluation Preliminary Results, Briefing (SC-228), November 
2014 

- Rorie, R. C., & Fern, L. (2015). The impact of integrated maneuver guidance information on UAS pilots 
performing the detect and avoid task. Proceedings of Human Factors and Ergonomics Society , Los Angeles, 
CA, Oct 26-30, to be published 

- IHITL results report/paper planned for October 2015 


Schedule Package: H.1.10 
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Measured Response Simulation C 



TC-HSI 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP H.1.20] 
Measured Response 
Simulation C 

10/2013 

• Investigate the effects of number of 
UAS per sector and types of UAS on GCS 
information requirements 

• Results inform understanding of ground control station 
automation levels and the number of UAS per NAS 
sector and types of UAS in the sector 


• Briefings, Papers, or Reports 

- UAS-HSI-4. 2-013-001, Measured Response Simulation C-Preliminary Data Analyses, 
Briefing, Undated 

- UAS-HSI-4. 2-019-001, UAS Response to Air traffic Control Clearances- Measured 
Responses, Paper, Undated 

- UAS-HSI-4. 2-020-001, Measured Response For UAS-NAS, Paper, Undated 

- UAS-HSI-4. 2-021-001, UAS Measured Response: The Effect of GCS Control Mode 
Interfaces on Pilot Ability to Comply with ATC Clearances, Paper, Undated 

- UAS-HSI-4. 2-023-001, Measured Response The effect of GCS Control Mode Interfaces 
on Pilot Ability to Comply with ATC Clearances, Briefing (HFES), 2014 

- UAS-HSI-4. 2-025-001, Air Traffic Controller Performance and Acceptability of Multiple 
UAS in a Simulated NAS Environment, Paper, Undated 

- UAS-HSI-4. 2-026-001, Air Traffic Controller Performance and Acceptability of Multiple 
UAS in a Simulated NAS Environment, Paper, July2014 


Schedule Package: H.1.20 
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Part-task Simulation 4: SAA Pilot Guidance 



TC-HSI 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP H.1.40] Part-task 
Simulation 4: SAA 
Pilot Guidance 

2/2014 

• Evaluate efficacy of minimum 
information SAA displays, potential 
improvements for advanced 
information features and pilot guidance, 
and integrated vs. stand-alone GCS SAA 
displays 

• Results inform ground control system display 

requirements associated with display class (integrated, 
stand alone), level of information (basic, advanced), and 
self-separation alerting threshold. 


• Briefings, Papers, or Reports 


- UAS-HSI-4. 2-022-001, PT4: DAA Display Evaluation-Prelim Results, Briefing (SC- 
228), August 2014 

— UAS-HSI-4. 2-033-001, An Evaluation of DAA Displays for Unmanned Aircraft 
Systems The Effect of Information Level and Display Location on Pilot 
Performance, May 2015 


Schedule Package: H.1.40 
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Part-task Simulation 5: SAA Pilot Guidance Follow-on 



TC-HSI 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP H.1.70] Part-task 
Simulation 5: SAA 
Pilot Guidance 
Follow-on 

2/2015 

• Evaluate various proposed informational 
and directive SAA displays to determine 
the basic information requirements and 
advantages of advanced pilot guidance 

• Results inform: 

• DAA display requirements 

• Classes of displays ability to meet proposed DAA GCS 
display requirements. 

• Selection of SAA display for the prototype research 
GCS for use in subsequent simulations and flight tests 


• Briefings, Papers, or Reports 


- Rorie, R. C., Fern, L., & Shively, J. (2016). The impact of suggestive maneuver 
guidance on UAS pilots performing the detect and avoid function. Proceedings of 
AIAA Science and Technology Forum and Exposition 2016, San Diego, CA, January 

2015 

- UAS-HSI-4.2-034-001, UAS-NAS Part Task 5 DAA Display Evaluation Primary Results, 
May 2015 

- UAS-HSI-4.2-032-001 , PT5 DAA Display Evaluation Overview III, June 2015 

- NAS Compliant Ground Station Part-task Simulation 5 report planned for January 

2016 


Schedule Package: H.1.70 
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Part Task Simulation 6 



TC-HSI 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP H.1.80] Full- 
Mission Simulation 2 

11/2015 

• Evaluate boundary between self 
separation and automatic collision 
avoidance mode 

• Demonstrate operation of an 
instantiation of a GCS illustrating one 
manner of compliance with GCS 
guidelines 

• Results inform: 

• Initial recommendations for allowable levels of 
automation 

• Demonstrate a robust system that provides: 

• Self-separation 

• Contingency management 

• Tolerable Pilot workload 

• High Pilot Situation Awareness 

• No adverse effects on ATM 

• Development of a prototype GCS that will instantiate 
one manner of compliance with proposed GCS 
guidelines and serve as GCS for the integrated events 


• Briefings, Papers, or Reports 

- Full-Mission 2 Briefing to SC-228 planned for March 2016 

- NAS Compliant Ground Station Full-mission Simulation 2 report planned April 2016 


Schedule Package: H.1.80 
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Visual Requirements for Landing Task 
(support for CSUN) 



TC-HSI 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP H.1.90] Visual 
Requirements for 
Landing Task 
(support for CSUN) 

10/2013 

• Evaluate nose camera video display 
requirements for manual takeoff and 
landing, and determine the minimum 
C2 bandwidth that still enables the safe 
execution of the takeoff and landing 
tasks 

• Results inform: 

• Requirements for visual displays for landing (e.g., 
resolution, frame rate, color) 

• CNPC system bandwidth requirements to support 
acceptable visual displays for landing 


Schedule Package: H.1.90 
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TC - HSI 




IC - Human Systems Integration 

[TWP H.l] RGCS 

[SP H.l. 10] HSI IHITL Participation & Data Collection 
[SP H.1.20] Measured! Response Simulation C 
[SP H.l. 30] Full-Mission Simulation 1: Levels of Automation 
[SP H.1.40] Part-task Simulation 4: SAA Pilot Guidance 
[SP H.1.50] HSI FT3 Participation & Data Collection 
[SP H.l. 60] HSI FT4 Participation & Data Collection 
[SP H.l. 70] Part-task Simulation 5: SAA Pilot: Guidance Follow-on 
[SP H.1.S0] Part Task 6 Simulation: Full Mission 2 
[SP H.1.90] Visual Requirements for Landing Task (support for CSUN) 
[TWP H.2] Guidelines 

[SP H.2. 10] GCS HF Draft Guidelines (Whitepaper) 

[SP H.2.20] GCS HF Preliminary Guidelines 
[SP H.2. 30] GCS HF Final Guidelines 
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Sim and Demo Planning Support & 
Leave Behind Capability 



• Research Objective: 

- Develop and maintain a relevant test environment to support sub-project research simulations, identify 
and document the LVC interfaces, and reduce risk for the integrated events by implementing the 
prototype infrastructure 



* Results, Conclusions, and Recommendations: 

- LVC test environment development 

• Developed scenarios and integrated test components for Part Task 4, reducing IHITL implementation risk 

• Enabled real-time remote viewing of flight data via distributed test environment for SSI Subproject portion of 
Communication Gen 2 flight test 

• Supported center connections to GRC and LaRC 

- Designed and developed a data archive scheme for integrated events 

• Proposing expansion of archive for all Project events 


Test Environment and Support for Draft DAA and C2 MOPS 


Schedule Package: T.1.10 & T.1.20 
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FT3 Execution 


• Research Objectives: 

- Conduct Flight Test Series 3 integrating the latest SSI algorithms, Control and Non-Payload Communication 
System prototype, and HSI displays using the Live, Virtual, Constructive test environment 

- Document the performance of the test infrastructure in meeting the flight test requirements 





* Results, Conclusions, and Recommendations: 

- Flight test divided into scripted encounters and full mission configurations 

- Scripted encounters finished successfully with 11 flights/208 test points: conducted June 2015 to July 2015 

• Ikhana as ownship, single and multiple simultaneous intruders 

• Due Regard Radar, ADS-B, and TCAS/Mode S sensors 

• Data was successfully collected for each test point and archived at NASA ARC for researcher access 

- Full mission finished after 3 flights: conducted August 2015 

• Distributed live aircraft at AFRC and virtual traffic from ARC 

• Surrogate aircraft command latency and performance issues 

- Required data provided to researchers on schedule 


Test Environment for V&V of DAA and C2 MOPS 


Schedule Package: T.4.50 
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Sim and Demo Planning Support 



TC-ITE 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP T.l. 10] Sim and 
Demo Planning 
Support 

10/2013 

• Not applicable 

• Not applicable 

[SP T.l. 20] Submit 
LVC Leave behind 
document 

10/2013 

• Not Applicable 

• Not Applicable 


• Briefings, Papers, or Reports 

- SP T.l. 10, None Planned 

- SP T.l. 20, LVC Leave Behind Capabilities Report, Planned for September 2016 


Schedule Package: T.l. 10 & T.l. 20 
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IHITL Relevant Environment Analysis 



TC-ITE 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP T.2.60] 

Integrated Human- 
in-the-Loop Relevant 
Environment 
Analysis 

2/2015 

• Evaluate the performance of the 

simulation infrastructure to emulate the 
intended Integrated Human-in-the-Loop 
operational system and provide a 
realistic environment for air traffic 
controller simulation subjects. 

• A realistic environment contributes useful data to SC-228 
MOPS development 


• Briefings, Papers, or Reports 

- UAS-ITE-5. 0-008-001, IHITL Test Environment Report 


Schedule Package: T.2.60 
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SAA Initial Flight Tests Execution 



TC-ITE 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP T.3.40] SAA 
Initial Flight Test 
Execution 

11/2014 

• Conduct SAA Initial Flight Test using the 
Live, Virtual, Constructive test 
environment and document the 
performance of the test infrastructure in 
meeting the flight test requirements 

• Results inform acceptability of the live, virtual, 

constructive distributed test environment as a realistic 
test environment for use in verifying and validating 
MOPS 


• Briefings, Papers, or Reports 


Schedule Package: T.3.40 
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FT3 Execution 



TC-ITE 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP T.4.50] FT3 
Execution 

6/2015 

• Conduct Flight Test Series 3 integrating 
the latest SSI algorithms. Control and 
Non-Payload Communication System 
prototype, and HSI displays using the 
Live, Virtual, Constructive test 
environment and document the 
performance of the test infrastructure in 
meeting the flight test requirements 

• Results inform acceptability of the live, virtual, 

constructive distributed test environment as a realistic 
test environment for use in verifying and validating 
MOPS 


• Briefings, Papers, or Reports 

- Integrated Flight Test 3 Flight Test Report, Planned October 2015 


Schedule Package: T.4.50 
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FT4 Execution 



TC-ITE 

Test/Simulation 

Baselined 
Execution 
Start Date 

Test/Simulation Objective 

Contribution to SC-228 MOPS 

[SP T.5.60] FT4 
Execution 

2/2016 

• Conduct Flight Test Series 4 integrating 
the latest SSI algorithms. Control and 
Non-Payload Communication System 
prototype, HSI displays, and active test 
aircraft sensors using the Live, Virtual, 
Constructive test environment and 
document the performance of the test 
infrastructure in meeting the flight test 
requirements 

• Results inform acceptability of the live, virtual, 

constructive distributed test environment as a realistic 
test environment for use in verifying and validating 
MOPS 


• Briefings, Papers, or Reports 

- Integrated Flight Test 4 Flight Test Report, Planned June 2015 


Schedule Package: T.5.60 
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TC-ITE (1 of 2) 




IC - Integrated Test and Evaluation 

[TWP T.l] LVC Distributed Test Environment 

[SP T.1.01] Modify MACS to emulate ERAM Display 
[SP T.l. 10] Sim and Demo PlanningSupport 
[SPT.1.02] External Partner Simulation Support 
[SP T.1.03] Aircraft check-out of LVC connectivity 
[SP T.l. 2.0] Leave Behind Capability 
[TWP T.2] Integrate Technology & Execute IHITL 

[SP T.2. 10] IHITL Scenario & Mission Development 
[SP T.2. 20] IHITL Test Planning 
[SP T.2. 30] IHITL Readiness & Reviews 
[SP T.2.40] IHITL Stand-up & Integration 
[SPT.2.50] IHITL Execution 
[SP T.2. 60] IHITL Relevant Environment Analysis 
[TWP T.3] SAA Initial Flight Tests 

[SPT.3.10] SAA Initial Flight Tests Readiness & Reviews 
[SP T.3. 20] SAA Initial Flight Tests Test Planning 
[SP T.3. 30] SAA Initial Flight Tests Standup and Integration 
[SP T.3. 40] SAA Initial Flight Tests Execution 


FY2014 


Q1 Q2 Q3 Q4 


FY2015 


FY2016 


qi Q2 qs 


q 4 qi q2 


qj q4 


♦ ♦ ♦ 


♦ 








♦I tek 






API 


LI Program (IASP) 


^ L2 Project 


Green Status Line Date 9/30/15 
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TC - ITE (2 of 2) 




[TWP T.4] Integrate Technology & Execute FT3 

[SP T.4. 10] FT3 Scenario & Mission Development 
[SP T.4. 20] Test Planning 
[SP T.4. 30] FT3 Readiness and Reviews 
[SP T.4.40] FT3 Stand-up & Integration 
[SPT.4.50] FT3 Execution 
[SP T.4. 60] FT3 Relevant Environment Analysis 
[TWP T.5] Integrate Technology and Execute FT4 
[SPT.5.10] Capstone Planning 
[SP T.5. 20] FT4Test Planning 
[SP T.5. 30] FT4 Scenario & Mission Development 
[SP T.5. 40] FT4 Readiness & Reviews 
[SP T.5. 50] FT4 Stand-up & Integration 
[SP T.5. 60] FT4 Execution 
[SP T.5. 70] FT4 Relevant Environment Analysis 


Q1 


FY2014 


Q2 Q3 


Q4 


FY2015 


Q1 Q.2 Q3 Q4 Q1 






o= 


FY2016 


Q2 Qi Q4 


=o 

=6 


API 


Ll Program (1ASP) 


L2 Project 


Green Status Line Date 9/30/15 
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FT4 Full Mission Ownship Evaluation Summary 



Required 

Ownship DAA Phase 1 MOPS Sensor Suite 
(2 of 3 sensors required) 

Autopilot 
Interface 
(Heading and 

RGCS C2 
Interface 

Contract 

Overall Assessment 

(see following chart for 

Desired 

ADS-B 

(1090 IN/OUT) 

Mode S 
Transponder 
(TCAS 1) 

A/A Radar 

TCAS II 

(v7.1) 

Tracker/ 

Sensor 

Fusion 

(latency from 
cmd 

Aircraft 

(8 nm 
detection 
range, 20° x 
30° FOR) 

Altitude Control 
from C2 link with 
GCS) 

execution to 
a/c response 
<2 sec ) 


additional details) 

AFRC Ikhana (870) 

Equipped 
(BAE DPX-7) 

N/A 

Equipped 
(GA-ASI 
EDM DRR) 

Equipped 
(HON TPA-100) 

Equipped 

(GA-ASI/HON 

SAAP) 

Full UAS 
(C2 link with 
Ikhana GCS) 

Can not 
implement 
in time 

Existing 

(GA-ASI 

Ikhana 

Support) 

Developing RGCS 
connectivity can not be 
completed in time due to 
IT Security constraints 

NGC Firebird 
Demonstrator 

Equipped 
(L3 TCAS/ADS- 
B) 

N/A 

Must be 
Integrated 
(AFRL/ 

CEI A/A Radar 
integration 
planned) 

Equipped 
(L3 TCAS/ADS- 
B) 

Equipped 

(NGC 

Airborne 

SAAP) 

Surrogate UA 
(C2 link with NGC 
GCS but onboard 
pilot must 
acknowledge 
cmds) 

Must be 
Integrated 
(NGC GCS G2 
is already 
STANAG 4586 
compliant) 

Need 

Could support FT4 Full 
Mission but must acquire 
a timely contract and 
address experimental 
airworthiness cert that 
requires onboard pilot 
acknowledgements 

Calspan Learjet 

Must be 
Integrated 

Must be 
Integrated 

Not an 
option 

Must be 
Integrated 

Must be 
Integrated 

Surrogate UA 
(Calspan Variable 
Stability System 
but no C2 link) 

Must be 
Integrated 

Existing 

(AFRC- 

Calspan 

BPA) 

Developing a C2 link and 
RGCS connectivity can 
not be completed in time 

AdvAero Avanti 

Equipped 
(but need 
interface to 
ADS-B data) 

Must be 
Integrated 

Must be 
Integrated 

Equipped 
(but need 
interface to 
TCAS data) 

Must be 
Integrated 

Surrogate UA 
(Heading control 
only and no C2 
link with GCS) 

Must be 
Integrated 

Need 

Developing a C2 link and 
RGCS connectivity can 
not be completed in time 


GRC T-34C (608) 



GRC S-3B (601) 


Equipped 

(GDL-88) 


Must be 
Integrated 
(GDL-88 
planned) 


Must be 
Integrated 


Must be 
Integrated 


Must be 
Integrated 
(HON TPA-100 
planned) 


Must be 
Integrated 


Surrogate UA 
(S-TEC55X 
equipped but has 
only heading 
conrol and cmd 
execution to a/c 
response latencies 
in excess of 2 sec 


Must be 
Integrated 


CNPC 


N/A 


CNPC 


N/A 


Assessment to be 
provided by joint 
AFRC/GRC independent 
review team 


Assessment to be 
provided by GRC 




10/08/2015 


FT4 Full Mission Ownship Evaluation 















FT4 Full Mission Ownship Evaluation Summary (con't) 



Required 

Ownship DAA Phase 1 MOPS Sensor Suite 
(2 of 3 sensors required) 

Autopilot 

Interface 

RGCS C2 
Interface 

Contract 

Overall Assessment 

(see following chart for 
additional details) ! 

Aircraft 

ADS-B 

(1090 IN/OUT) 

Mode S 
Transponder 
(TCAS 1) 

A/A Radar 

(8 nm 
detection 
range, 20° x 
30° FOR) 

TCAS II 

(V7.1) 

Tracker/ 

Sensor 

Fusion 

(Heading and 
Altitude 
Control from 
C2 link with 
GCS) 

(latency 
from cmd 
execution 
to a/c 

response <2 
sec ) 

LaRC SR-22 (501) 

Must be 
Integrated 
(equipped with 
UAT only) 

Not an 
Option 

Not an 
Option 

Not an 
Option 

Must be 
Integrated 

Surrogate UA 
(S-TEC55X 
equipped but 
UHF C2 link 
with GCS is 
limited in 
range) 

Must be 
Integrated 
(UHFC2 
Link limited 
in range) 

N/A 

Unable to integrate 2 
surveillance sensors 

LaRC HU-25C (525) 

Equipped 
(but need 
interface to ADS-B 
data) 

Must be 
Integrated 

Must be 
Integrated 

Equipped 
(but need 
interface to 
TCAS data) 

Must be 
Integrated 

Must be 
Integrated 

Must be 
Integrated 

N/A 

Developing a C2 link 
and RGCS connectivity 
can not be completed 
in time 

AFRCGIII 

(502) 

^ Gill (992) 
AFRCGIII (808) 

Must be 
Integrated 

Must be 
Integrated 

Must be 
Integrated 

Equipped 
(but need 
interface to 
TCAS data) 

Must be 
Integrated 

AFRC Platform 
Precision 
Autopilot but 
no C2 link to 
GCS 

Must be 
Integrated 

N/A 

Aircraft not available to 
support integration and 
test schedule 

Must be 
Integrated 
(GDL-88 planned) 

Must be 
Integrated 

Must be 
Integrated 

Must be 
Integrated 

Must be 
Integrated 

Must be 
Integrated 

Must be 
Integrated 

N/A 

Developing a C2 link 
and RGCS connectivity 
can not be completed 
in time 


10/08/2015 


FT4 Full Mission Ownship Evaluation 
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UAS-NAS Non-Technical Challenge Work 

Backup Slides 
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Certification Task/Product View Timeline On/Off-Ramps 



Partners/ 

Type Certification Development 

Analysis & Reporting 

CONOPS/ 
Design Data 

(conventional & argument-based) 



Define CONOPS 
and UAS 
Requirements 


Develop Type Certification Basis 


Analyze and Report on Type 
Certification Basis 


Analyze and Report on Applicability to Future UAS 
and Operations 


Report on 
Applicability 
to Future 
UAS & Ops 



3/14 

Authority to 
Proceed 


6/14 9/14 12/14 3/15 6/15 

Partnership Eliminate Stop work after 

Established Safety Case development of type 

Work certification basis 


9/15 12/15 

Stop work after 
first deliverable 
report on the type 
certification basis 


3/16 6/16 

Stop work after any one 
of the analysis questions. 
That is, there will be 
logical breakpoints 
throughout the analysis 
phase to stop work. 


9/16 
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sUAS Plan and Status 



• sUAS Sense and Avoid Barrier Elimination: 

- Developed research plan to assess sUAS SAA current 
state-of-the-art capabilities 

- Created partnerships with various organizations to 
assess a variety of methodologies using real-world data 
to be supplied by NASA 

- Conducted first set of 12 multi-UAS video encounter 
experiment flights at Ft. A. P. Hill Sept. 21-25, 2015 

• Next Steps: "Publishing" the data base and conducting 
the algorithmic assessments with partners. 




Vehicle crossing 
Flight path 


2011 io:so:42 





Non-Technical Challenges 


Non-Technical Challenge 

[TWP N.l] Certification 
[SP N.1.10] Case Study 
|SP N.1.20] Analysis 

[TWP N.2] sUAS Support to Initial Rulemaking 
[SP N.2. 10] sUAS Testing 

[SP N.2.2G] Overcoming sUAS Sense and Avoid Barrier 

Augmentation 

[TWP N.3] Standard LVC-DE Connection and Interface 

[SP N.3. 10] Prototype connection equipment & Test Site Connections 
[SP N.3. 20] LVC Connection to scaled Vehicles 
[SP N.3. 30] Investigation of UAS LVC middleware 
[TWP N.4] UAS Aircraft and Trajectory Modeling 

[SP N.4.10] UAS Model development and integration 
[TWP N.6] Distributed Display Infrastructure 

[SP N.6. 10] Distributed display infrastructure set-up 
[TWP N.7] Data Storage and Accessibility 

[SP N.7.10] SatCom emulation capability on LVC 

[SP N.7.20] Adaptable SAA Architecture and LVC Connection 








T I 


I I I 


l=^P 


1 1 



FY2014 

FY2015 

FY2016 

Q1 

Q2 

Q3 

Q4 

Q1 

Q2 

Q3 

Q4 

Q1 

Q2 

Q3 

Q4 


o 


API 


LI Program (IASP) 


L2 Project 


Green Status Line Date 9/30/15 
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Augmentation Technical Status Summary 



Task 

Status 

3.1 Prototype connection 
equipment & test site 
connections 

Complete FY15: All Test Sites under contract to connect to the LVC 
Remaining FY16: All Test Sites will perform actual connection work in FY16 

3.2 LVC connection to scaled 

vehicles 

Complete FY15: Preparation for install complete, all hardware purchased, and some hardware 
installed 

Remaining FY16: Install remaining hardware, connect Airstar "mid-sized" UAS, demonstrate HLA 
bridge 

3.3 Investigation of ideal 
middleware 

Complete FY15: Report delivered documenting recommendations for short and long term 
connectivity. Recommendations will be used for Test Site Connections and 
other longterm partners. 

Remaining FY16: none 

4.1 VFR Traffic Model 
Development and 
Integration 

Complete FY15: Processing VFR track data from 21 sample days, and apply a noise reduction 
algorithm 

Remaining FY16: Create ACES formatted scenario files, and use ACES to fully smooth the data, 
then deliver new, smoothed VFR track data by Nov 20 

6.1 Distributed Display 
Infrastructure Set-up 

Complete FY15: All hardware procured for each center 
Remaining FY16: Final installations and checkout 

7.1 Satcom emulation 
capability on LVC 

Complete FY15: Developed requirements, purchased hardware, performed initial lab testing 
Remaining FY16: Finalize software update on S-3B and perform LVC connectivity testing for 
flight test data collection 

7.2 Adaptable SAA 

Architecture and LVC 
Connection 

Complete FY15: GA under contract to deliver ARP capability 

Remaining FY16: Implement upgrades to allow NASA algorithms to run in place of current SAA- 
related algorithms to command vertical speed and heading changes 
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Standard LVC Connection and Interface 


Technical Objectives: 

- Investigate LVC middleware options for future simulations and flight testing 

- Establish connection between each UAS Test Site and the LVC 

- Develop interface and test connection between scaled models and LVC 



NUANCE Lab 
Nevada Test Site 


MOCC 

MAAP Test Site 


Flight Control 
Alaska Test Site 


LSUASC HLA 


UAS GCS 


SRC LSTAR 


Lone 


Star Test Site 


ND Test Site 


Griffiss Test Site 


MQ-9 
MQ-9 GCS 
General Atomics 


Live 

Surveillance 

Excelis 


GCS Sims 

Air Traffic Control 
WJHTC 


Air Traffic Control 
MACS GCS 
Background Traffic 
SGT Connection 

ATOL Connection 
AirStar 


LaRC 



Air Traffic Control 
Vigilant Spirit GCS 
Background Traffic 
B747 Simulator 

Video Server 
ARC 


Research GCS 

Ikhana MQ-9 

Restricted Airspace 

Live Intruders 
AFRC 

T-34C 

S-3B 

Terrestrial Com 

SatCom 

GRC 


• Significant Results, Conclusions, and Recommendations: 


- LVC middleware report outlines strategies for long term LVC connectivity 

- All 6 UAS Test sites under contract; planning prototype connection test FY16 Q3 

- Initial connection of LaRC AirStar system to LVC complete; check-out test expected in 
December 


Investigation of ideal middleware; Prototype connection equipment & test site connections; LVC 

connection to scaled vehicles 
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Augmentation Packages: 3.1; 3.2; 3.3 


SV*. 











LVC Connection to Scaled Vehicles 

• Technical Objectives: 

Develop Infrastructure to enable addition of vehicles into the LVC to conduct live testing of DAA 
algorithms for Phase 2 MOPS (BAT, AirStar, Flight Operations and Command Center) 

Create a UAS Research Data Collection and Repository (Actual Database Server SW and HW) 

Deploy and test Display software for Common Operating Picture for use in UAS Lab in Phase 2 MOPS 
Development. 




Establish LaRC as a full node on LVC: Include IT infrastructure, storage, connectivity, communication 



* Significant Results, Conclusions, and Recommendations: 

Performed architecture analysis 

Purchased and installed enabling hardware: LVC Gateway servers, AirStar hardware, Video wall 
installation pending 

DDS-LVC Gateway toolbox complete, pending gateway test; LVC Gateway installed 
DDS-HLA Bridge in development 


Investigation of ideal architecture; Prototype connection equipment & center-to-center connections; 

LVC connection to scaled vehicles 


Augmentation Package: 3.2 
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Distributed Display Infrastructure 

• Technical Objectives: 

- Develop the ability to share displays to be across locations connected to the LVC (i.e. 
aeronautics centers), without changing the test software or impacting test subjects 

- Update displays at Ames IT&E demonstration and tower facility 





Video Streaming 
Service 

ARC 




• Significant Results, Conclusions, and Recommendations: 

- Video streaming equipment procured and tested between AFRC and ARC 

- Video server and display equipment procured; connection between ARC and each Center in place; testing 
planned for FY16 Q1 

- Display projector bids under evaluation for FY16 installation 
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Augmentation Package: 6.1 












SatCom Emulation Capability on LVC 


• Research Objective: 

- Develop SatCom emulation capability and interface to LVC, in order to assist in the 
development of SatCom specifications and UAS operations ConOps under higher 
communication latency conditions. 





* Significant Results, Conclusions, and Recommendations: 

- Developed SatCom emulation requirements 

- Developed SatCom emulation 

- Performed initial lab testing of SatCom emulation 

- Currently updating software on S-3B aircraft. 

- Coordinating with ARC on LVC system connectivity for flight test data collection. 


SatCom CNPC System Performance Requirements for C2 MOPS 


Schedule Package: N.7.10 
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UAS-NAS Capstone 
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Define & Apply Weighting Criteria 


Opportunity: Ability to accelerate schedule, reduce costs, and leverage 
technologies 

— Clarity and efficiency of implementation path 

- Collaboration with others 

- Leverage existing technologies and efforts 

Risk : Effects from not achieving the desired outcome 

— Size, complexity, and difficulty of implementation 
— Negative impact on civil/commercial market 

- Potential delays to full integration 

- Degrading efficiency of the NAS (without degrading safety) 

Benefit : Impact toward achieving the overall vision of "full integration " 



Prioritize Remaining Gaps 

Benefit adjusted Opportunity / Risk Tornado Diagram 


Risk Opportunity 
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Prioritize Remaining Gaps 
Lead / Collaborate / Leverage Recommendations 
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MOE Considerations 


• Attendance : 30-40 people max 

• Purpose : Attain consensus from the UAS community on... 

— Bin definitions 

- Vision/concepts of what it means to be complete 

- Gaps to achieve full integration 

• Representation: 

- Various organizations (e.g. FAA, RTCA, DOD, AUVSI, Academia, Industry, etc) 

- Experts in each technical area (e.g. DAA, C3, Automation, Ops, etc) 

• Recommendation : Separate audience into smaller break out groups 

- Read-ahead material and telecon 2 weeks prior will set the stage and instigate 
initial inputs/questions/comments for review 

- All attendees involved in every bin is inefficient, disengaging and will be very 
difficult to reach consensus 

- Most people will have knowledge overlapping multiple bins. Some bins will require 
more participation, or be more controversial 

- One MTSI person will facilitate each breakout session 
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Phase 2 MOPS Support Planning 
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Project Processes Implementation 

Backup Slides 


167 



FY15 Significant Changes Against Baseline 



CR(s)# 

Area 

Change 

Impact 

(Cost, Schedule, 
Technical) 

040 

PO 

Redefined L2 Milestones related to Comprehensive Research Report to reflect 1 final report. Final 
report was elevated to LI Milestone - "Comprehensive FT4 Research Report" 

Schedule, 

Technical 

042, 

043, 
067 

TC-SAA 

Closed/eliminated SP S.3.20, "Well Clear Alerts/Resolutions with VFR and Pilot/Controller (ACES 
Simulation)" and added SP S.3.30, "Well Clear Alerting Logic, Methods, and Performance 
Requirements" to provide greater benefit to SC-228 by conducting work of greater importance to 
SC-228 

Schedule, 

Technical 

049 

PO 

Reallocated funds to LaRC for CASSATT efforts 

Cost 

053, 

079 

TC-HSI 

Deletion of L2 Milestone - "HSI PT4B Briefing to RTCA" (CR053) and deletion of associated tasks 
(079) as briefing was to be completed by GA, and not HSI. 

Schedule, 

Technical 

058, 

062 

TC-ITE 

Original FT4 Test Plan was broken into an ORD and the FT4/Capstone Test Plan. FT4/Capstone test 
plan was captured in CR062. Creation of L2 Milestone - SP T.5.50, "FT4/Capstone Flight Test Plan" 

Schedule, 

Technical 

064 

Non-TC- 

sUAS 

Additional work approved for sUAS - N.2.20 sUAS SAA Testing 

Cost, Schedule, 
Technical 

065 

PO 

LI Milestone date changes to MOPS comments to coincide with SC-228 schedule 

Schedule 

070 

Non-TC- 

Certification 

Deletion of L2 Milestone. GSN Safety case did not meet the original intent of the deliverable 

Cost, Schedule, 
Technical 

080 

TC-HSI 

Reallocated funds to HSI for MUSIM efforts 

Cost 

083 

TC-C2 

Deletion of FT3 related milestone as subproject was not intending to use FT3 data to brief SC-228 

Technical 

086 

ITE 

Documentation of FT3 Completion. 

Technical 

088 

TC-HSI 

Deletion of FT3 related milestone. Data was found to be insufficient to brief to SC-228 

Technical 

091 

PO 

Reallocation of funds to cover the following: FAA Test Site efforts, TCAS II antenna, and to fund HSI 
grant with CSULB. 

Cost 

i 



FT3 Related Change Requests 


• Change Requests Related to Schedule 


CR# 

Project/ TC 

Title /Description 

014 

SSI 

TC-SAA L2 Milestone Changes; change in date for 

020 

HSI 

TC-HSI L2 Milestone Changes in TWP H.l; change in date for HSI FT3 
Briefing to RTCA 

026 

PO 

ADD API Level 1 Milestone for FY16 - FT3 

046 

ITE 

Change to FT3 Configuration Freeze date 

047 

ITE 

Change to FT3 FDR Date 

061 

PO, SAA, C2, HSI, ITE 

Change to FT3 Completion Date - LI Milestone 


• Change Requests Related to Technical 


CR# 

Project/ TC 

Title /Description 

014 

SSI 

TC-SAA L2 Milestone Changes; change in date for 

086 

PO 

FT3 Completion 

083 

C2 

TC Comm Level 2 Milestone deletion 

088 

HSI 

TC HSI, SP H.1.50 Level 2 Milestone deletion 
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FT3 Related Risks 



Risk ID 

Project/ TC 

Risk Title 

Status 

U. 1.1.10 

PO 

Output from Test Events has value to Project Stakeholders 

Mitigate 

U.4.3.8 

C2 

Radios flight tested in FT3 and FT4 Series may not fully validate MOPS 

Closed 7/31/2014 

U.4.3.9 

C2 

FT3 CNPC Preparations Stressing C2 Preliminary MOPS Development 

Closed 9/24/2015 

U.4.3.10 

C2 

FT3 Radio Frequency Coverage 

Closed 9/24/2015 

U.4.3.11 

C2 

FT3 CNPC Equipment Installation at California 

Closed 9/24/2015 

U.4.1.4 

SAA 

A test bed for airborne sense and avoid flight tests equipped with the 
command and non-payload communications radio may not be available 

Closed 10/16/2014 

U.4.1.9 

SAA 

Delay of TCI/SSI Technology Developments Impact to Integrated Test Events 
(IHITL, FT3 and FT4) 

Mitigate 

U.4.2.9 

HSI 

Delay of TC3/HSI Technology Development Impact to Integrated Test Events 
(IHITL, FT3 and FT4) 

Mitigate 

U.4.2.11 

HSI 

Availability of Vigilant Spirit Control Station for Flight Test Series 

Mitigate 

U.5.1.7 

IT&E 

Distributed Test Environment requirements for Integrated 
Flight Test 3 (FT3) not defined 

Closed 3/26/2015 

U. 5. 1.10 

IT&E 

Required Assets for Flight Test 3 (FT3) not available during test period 

Closed 8/20/2015 

U. 5. 1.15 

IT&E 

Inability to achieve TCAS II Self-separation IHITL Objectives due to lack of an 
IT Security Authority to Operate (ATO) 

Closed 4/17/2014 

U. 5. 1.16 

IT&E 

Completion of TC6/IT&E Technical Objectives that Rely upon Formal 
Partnerships 

Closed 5/23/2015 

U. 5. 1.17 

IT&E 

The T-34 (UA Surrogate) for FT3 and FT4 may not be available 

Watch 

U. 5. 1.23 

IT&E 

No formal agreement in place to access Honeywell data fusion algorithm 

Mitigate 

U. 5. 1.24 

IT&E 

Timing of Part Task 5 impact on Flight Test 3 design 

Closed 4/23/2015 

U. 5. 1.25 

IT&E 

Shortage of Resources - AFRC IT Security Experts 

Closed 7/23/2015 

U. 5. 1.26 

IT&E 

ADS-B Receiver may not be received in time to support FT-3 

Closed 8/20/2015 

U. 5. 1.27 

IT&E 

FT-3 Ikhana and Intruder Pilot Availability 

Closed 8/20/2015 




Subproject 

Execution 

Risk ID: 
U.5.1.17 

Risk Owner: 
Jim Griner 
TC-ITE 
Trend 

Criticality 


The T-34 (UA Surrogate) for FT3 and FT4 
may not be available 



Risk Statement 


Oriainal Impact 

Given the FT3 and FT4 activities require the T- 
34 be utilized as a UA surrogate aircraft 


Technical = 5. Should the T-34 not be available for flight test the LI 
milestones associated with FT3 and FT4 will not be met. 

(containing the CNPC radio), should the T-34 


Schedule = 5. A greater than 2 month schedule slip may be incurred if 

not be available for FT3 and/or FT4 the LI 


the T-34 aircraft is not available for flight test 

milestones associated with FT3/FT4 will not 


Cost = 1. TBD 

be met. 



Status 


1 f 


Current L x C 

1 x 3 

(Technical =3, 
Schedule = 3, 
Cost = 1 ) 

Target L x C 

1 x 3 

Open Date 

11/25/13 

with 

1x5 

Planned 
Closure Date 


study completion 



9/24/2015: Risk not accepted for closure at MRB. Risk will remain in watch status. 

9/15/2015: Risk proposed for closure. 

8/18/2015: Risk will remain in watch. Need to review after FT3 meetings (August 24-25 and September 9-10). 
12/4/14: Risk will remain in watch. 

9/18/14: Reviewed risk during IT&E RWG meeting. Risk to trending flat (unchanged) at this time. 

Risk Approach: Watch 

Mitigation Trigger (if current action is Watch): At GRC airplane being considered to support other operations in same timeframe as FT3/FT4 


Mitigation Step/Task Description: 

Cost to Implement 

(if exceeds current budget) 

Start 

Date 

End 

Date 

New LxC 

C: (Tech, Schedule, Cost) 

Conduct Glenn T-34 replacement/back-up trade study 
for Flight Test 3. COMPLETE 


12/16/13 

4/15/14 

1x3 

C: (T3,S3, Cl) 

Conduct Glenn T-34 replacement/back-up trade study 
for Flight Test 4. 

(Mitigation 02) 


TBD 

TBD 

1x3 

C: (T3,S3, Cl) 


Rationale for Closure: 
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Validation of SAA Sensor Models 


Subproject 
Execution 
Risk ID: 
U.4.1.11 

Risk Owner: 
Santiago 

TC-SAA 

TWP: 

Trend 


Top Risk 


Risk Statement 

Given the lack of access to a sensor suite that includes both cooperative 
and non-cooperative sensors (e.g. TCAS, ADS-B, EO/IR, airborne radar) 
there is a possibility that the validation of the sensor models used in ACES 
and PT6 won't be completed. Actual implementations of SAA capabilities 
will need to address real-world sensor uncertainties, and will be studied in 
simulation. Validation of the sensor models will require access to flight test 
platforms with sensor suites that include both cooperative and non- 
cooperative sensors (e.g. TCAS, ADS-B, EO/IR, airborne radar) to enable the 
validation of ACES results that will support surveillance requirements 
covered in the DAA MOPS. The completion of these research tasks may be 
impacted by lack of access to a sensor suite, since NASA does not own a 
flight asset with a SAA sensor suite. 

Status 



Original Impact 

Technical = 3; Some impact to objective. Not validating 
sensor models may impact SC-228 MOPS development. If 
sensor models are not delivered by 1/19/16 there will be an 
impact to PT6 and the "comprehensive" ACES simulation. 
Schedule = 1; No impact 

Cost = 2; This requires contracting out to reduce this risk. 


Criticality 

Med 

Current L x C 

3x3 

(Technical =3, 
Schedule = 1, 
Cost = 2) 

Target L x C 

2x2 

Open Date 

7/15/2014 

with 

3x3 

Planned 
Closure Date 

1/19/2016 



9/15/2015: Risk is trending flat. Integration of sensor model into ACES from Honeywell is going well. Matlab has been auto 
coded. Once complete, team will be testing against Matlab results to ensure there are no bugs. Team has the data from FT3 
configuration 1 that passed through the Honeywell tracker. Data is sufficient to validate model. End date of mitigation 02 
extended form 8/31/2015 to 10/31/2015 due to no-cost extension added to Honeywell contract. 

8/17/2015: Risk is trending up. LxC score increases from 2x3 to 3x3. Integration and testing of models may not be complete by 
8/31 (issue with generic fusion algorithm and not finished integration task). Honeywell is pursuing 2-month no-cost 
extension. This adds risks to PT6 and ACES sim using models. Mitigation 03 added. 


Risk Approach: Mitigate 


Mitigation Step/Task Description: 

Cost to Implement 

(if exceeds current budget) 

Start 

Date 

End 

Date 

New LxC 

C: (Tech, Schedule, 
Cost) 

Contract out the validation of sensor models and 
tracking/fusion algorithms using data from representative 
flight tests (Santiago) COMPLETE 

FY15=$190k 
FY14 = $362k 

7/15/14 

9/30/14 

3x3 

C: (T3,S1, C2) 

Execute representative flight tests and carry out validation of 
sensor models and tracking/fusion algorithms using flight test 
data (Mitigation 02) (Santiago) 

NA 

1/1/15 

8/31/15 

10/31/15 

2x2 

C: (T2,S1, Cl) 

Add task to Honeywell contract stating that they will supply 
their Data Fusion Software and support integration for PT6 
and "comprehensive" ACES simulation. (Mitigation 03) 
Santiago) 


8/17/15 

1/19/16 

2x2 

C: (T2,S1, Cl) 
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Subproject 

Execution 

Risk ID: 
U.5.1.11 

Risk Owner: 

Kim/Murphy 

TC-ITE 

TWP: ITE 

Trend 


Criticality 

Med 

Current L x C 

3x3 

(Technical = 2 
Schedule = 3 
Cost = 1 ) 

Target L x C 

1 x 3 

Open Date 

4/11/13 

with 

3x3 

Planned 
Closure Date 

1/4/16 



Required Assets for Flight Test 4 (FT4) not 
available during test period 


Risk Statement 

Distributed Test Environment assets required to execute Flight Test 4 
are not available during the data collection period, FT4 reporting and 
closeout. This will impact LI milestone UAS/NAS FY16 Annual 
Performance Indicator (API) and FT4 test planning activities and 
schedule. Technical delays in integrating components of the 
Distributed Test Environment results in schedule slips past test event 
milestones. 

Status 



Original Impact 

Technical = 2; This will put the LI milestone UAS/NAS FY16 
Annual Performance Indicator (API) at risk. 

Schedule = 3; Technical delays in integrating components of the 
Distributed Test Environment results in schedule slips past test 
event milestones. 

Cost = 1; Bringing in additional WYEs or FTEs will not prevent 
slippage in schedule because appropriate skill mix is needed 


9/15/2015: Mitigation 01 includes all assets including identifying intruders. End dates for mitigations 01 and 1A 
extended form 9/30/2015 to 11/13/2015. End dates for mitigations 02 and 03 extended from 10/16/2015 to 
11/13/2015 to coincide with the FT4 ERT. Review of risk is ongoing through FT4 path forward and decision point 2 
(Nov 13) outcome. 

8/20/15: Need to review/clean-up risk after post FT3/FT4 path forward meetings (August 24-25 and September 9-10). 

8/18/15: Jim Murphy provided updated text for Mitigation 1A. 

Risk Approach: Mitigate 


Mitigation Step/Task Description: 

Cost to Implement 

Start 

Date 

End 

Date 

New LxC 

Determine required FT4 assets (including facility and equipment 
requirements). [Kim/Murphy/All PEs] (Mitigation 01) 

TBD 

1/15/15 

9/30/15 

11/13/15 

2x3 

(T2,S3, Cl) 

Create plan and schedule for procuring long lead facilities or equipment 
identified during requirements gathering and system design and track 
integration into the test environment. If necessary, track asset 
procurement and integration under a separate risk, (Mitigation 1A) 

TBD 

7/20/2015 

9/30/15 

11/13/15 

2x3 

(T2,S3, Cl) 

Develop rapid prototype interfaces into the LVC for new components. 
[Kim/Murphy/All PEs] (Mitigation 02) 

NA 

4/11/13 

10/16/15 

11/13/15 

2x3 

(T2,S3, Cl) 

Schedule assets that meet specified requirements for the time periods 
that cover the testing and conduct of FT4. [Kim/Murphy/All PEs] 

(Mitigation 03) 

NA 

1/15/15 

10/16/15 

11/13/15 

1x3 

(T2,S3, Cl) 

Identify and procure key equipment that can be readily replaced if 
failure occurs during testing and where procurement of a replacement 
is economically feasible. [Kim/Murphy/All PEs] (Mitigation 04) 

TBD 

10/1/14 

1/4/16 

1x3 

<T i' S3 ' c iy 3 






Distributed Test Environment requirements for Integrated 

Flight Test 4 (FT4) not defined 


Project Success 
Risk ID: 
U.5.1.8 
Risk Owner: 
Kim/Murphy 

TC-ITE 
TWP: ITE 
Trend 

Criticality 


Med 


Current L x C 
2x3 

(Technical = 2 
Schedule = 3 
Cost = 1 ) 

Target L x C 

1 x 3 

Open Date 

3/16/13 

with 

3x3 

Planned 
Closure Date 

10/13/15 



Jfc 



Risk Statement 


Oriainal Impact 

Given timely definition of system requirements is 


Technical = 3; If LVC system requirements are not defined per schedule then 

necessary in order to ensure proper development of the 


FT4 L2 dates will not be met. 

environment, delayed execution of FT4 reporting and 


Schedule = 3; The Level 1 milestone, UAS/NAS FY14 Annual Performance 

closeout will impact the execution of the LI milestone 


Indicator (API) will be at risk. 

Capstone Event and FY16 Project reporting and closeout 
by Sep 30 th , 2016. 


Cost = 1; De-Scope 


Status 

9/15/2015: Mitigation 03 is complete. End dates of mitigations 04 and 05 extend from 8/31/2015 to 10/31/2015. 
Review of risk is ongoing through FT4 path forward and decision point 2 (Nov 13) outcome. 

8/20/15: Need to review/clean-up risk after post FT3/FT4 path forward meetings (August 24-25 and September 9-10). 

8/6/15: Risk continues to trend flat. End date for Mitigation 03 extended from 7/31/15 to 8/31/15. Documented the 
radar requirement and noted that IT&E is not going to meet it. 


Mitigation Step/Task Description: 

Cost to Implement 

(if exceeds current budget) 

Start 

Date 

End Date 

New LxC 

C: (Tech, Schedule, Cost) 

Conduct IHITL SRR to define draft and include all known 
FT3 and FT4 requirements for inclusion in IHITL SRR. 

(Mitigation 01 COMPLETE 

N/A 

8/1 5/13 

11/7/13 

2x3 

C: (T3,S3, Cl) 

Define draft and include all known FT4 requirements for 
inclusion in FT3 SRR. (Mitigation 02) COMPLETE 

N/A 

8/1 5/13 

9/1 0/2014 

2x3 

C: (T2,S3, Cl) 

Work with the researchers to define and baseline specific 
FT4 objectives and test requirements and disseminate them 
to the key stakeholders for review. (Mitigation 03) COMPLETE 

N/A 

3/25/15 

7/31/15 
7/1 5/15 
8/21/15 

2x3 

C: (T2,S3, Cl) 

Lessons learned from Flight Test 3 Activity will be applied to 
FT4. (Mitigation 04) 

N/A 

9/1/14 

8/31/15 

10/31/15 

2x3 

C: (T1,S3, Cl) 

Complete the FT4 specific requirements document with 
inputs from FT3 lessons learned and stakeholder responses 
to the baseline. (Mitigation 05) 

N/A 

3/25/15 

8/31/15 

10/31/15 

1 x 3 

C: (T1 ,S3, Cl) 

Develop the ITE architecture description document by 
baselining the FT3/FT4 architecture for the Distributed Test 
Environment (Mitigation 06) 

N/A 

6/6/13 

10/13/15 

11/13/15 

1 x 3 

C: (T1 ,S3, Cl) 17^ 


SV*. 






Output from Test Events has value to Project Stakeholders 

— JBapjttak 


Project Success 
Risk ID: 

U.1.1.10 
Risk Owner: 
Randall 

Project 

Trend 


Risk Statement 

Given the diversity of testing to be conducted and schedule and cost 
constraints, it is possible that the type/kinds of data collected during 
tests may not be sufficient or timely for MOPS development. 

The Project is conducting subproject individual and joint testing, and 
the integrated test events. Output from these events need to 
provide value to the Project Stakeholders. Superseded risk 
U.5.1.5. 



Original Impact 

Technical = 4; Technology maturation may be moderately impacted by ; 
failure of the Project to deliver data products relevant to the needs of 
our Project Stakeholders. 

Schedule = 3; Added flight or simulation events will slip schedule. 

Cost = 2; If the Project needs to add a flight or simulation event to 
collect data due to non-delivery of relevant data to a stakeholder, then 
the marching army costs for the event could be an issue. 


Status 


t 


Criticality 

Med 


Current L x C 

2x3 

(Technical =3, 
Schedule = 2, 
Cost = 2) 

Target L x C 

2x3 

Open Date 

4/24/14 

with 

3x4 

Planned 
Closure Date 

7/1/16 



9/15/15: LxC and additional mitigations will be assessed based upon FT4 path forward and decision point 2 (Nov 13) outcome. 

8/6/15: Risk is trending up. Loss of radar on S3-B caused a significant change to what was planned. May add additional mitigations as result of 
next steps. 

7/20/15: Risk continues to trend flat. Hosting four members from SC-288 DAA V&V working group at AFRC July 20 th and 21 st . Plan to support 
SC-288 DAA V&V working group meeting in Phoenix August 11-13. 

6/4/15: Risk is trending flat. Debra Randall briefed SC-228 and explained how to communicate requirements that they wanted for FT4 and how 
NASA would take those requirements in and determine if we would meet them or not. On May 29 th Debra briefed Code R on plan to 
coordinate with stakeholders. 


Risk Approach: Mitigate 


Mitigation Step/Task Description: 

*Closed mitigations listed in notes section (Mitigations 01, 02, 03, 05 09) 

Cost to 
Implement 

Start 

Date 

End 

Date 

New LxC 

C: (Tech, Schedule, Cost) 

Provide the Project L1/L2 Milestones, Milestone Dates, and Project 
Requirements Document to our Stakeholders [FAA (ANG-80, AFS-80), 
SC-228 DAA and C2 Working Groups, and SARP] (Mitigation 04) 

NA 

3/1//14 

9/30/15 

2x3 

C: (T3, S2, C2) 

NASA project personnel coordinate with SC-228 working group peers to 
identify opportunities for flight test 4 to support development of MOPS 
requirements. Then brief test design, plans, and objectives to SC-228 

WG (Mitigation 06) 

$0 

3/1/14 

1/15/16 

2x3 

C: (T3, S2, C2) 

NASA project personnel coordinate with SC-228 working group peers to 
identify opportunities for subproject test events to support 
development of MOPS requirements. Then brief test design, plans, and 
objectives to SC-228 WG. (Mitigation 07) 

$0 

3/1/14 

7/1/16 

2x3 

C: (T3, S2, C2) 

NASA Project personnel to brief test objectives, design, and plans to FAA 
personnel and obtain stakeholder feedback for FT3 & FT4. (Mitigation 08) 

$0 

10/1/14 

3/30/15 

10/1/15 

2X3 17 

C: (T3, S2, C2) 



UAS-NAS Project Focus Changes Due to External 
Influences 



Risk ID: 02 


Trend 



Criticality 

Med 


Current L x C 

2x3 

(Technical = 3, 
Schedule = 3, 
Cost = 3) 

Open Date 

4/12/12 

with 

3x3 


Planned 
Closure Date 

7/1 5/1 6 


Risk Statement 

Discussions between NASA, FAA and others in the UAS community 
were used to identify project Technical Challenges, which were used 
to scope project content during Formulation. These activities 
continue to refine the UAS integration in the NAS efforts at the 
national level through roadmap development. While IASP and the 
UAS-NAS Project participate in these activities, resultant changes to 
the UAS roadmap could lead to changes in UAS-NAS Project 
content. This risk captures the potential for loss of relevance of UAS- 
NAS work content and the potential that stakeholder/customer needs 
might change. 

Status 

4/9/15: Updated risk to reflect FY15 ARMD restructure nomenclature with new Program name IASP 

03/13/14: Worked with UAS-NAS Project Risk team and Stuart to create new mitigation steps on 2/19/14. The FAA Roadmap and 
JPDO Comprehensive Plan were released on November 7th, 2013. This in turn closed our second mitigation. 

01/08/14: RTCA SC-228 White papers have been through the FRAC process as of 12/6/2013 and the white papers should be 
released through the PMC in the March timeframe. NASA work has been evaluated against white papers and the portfolio 
does not appear to require changes in focus. Additionally, NASA has worked closely with the SARP at Well Clear and Deep 
Dive workshops to ensure relevance of other SAA and HSI TWP's. 

11/14/13: This risk will likely be lowered with the release of the white paper. The stability and maturity of SC-228 should also 
lower this risk. 

8/22/13: Likelihood decreased to 2 based on: Independent assessment from the NAC; participation in SC-228; and development 
of Phase 2 portfolio that is aligned with ARC implementation plan, FAA ConOps and JPDO comprehensive plan. 

4/25/13: RTCA released a new ToR which eliminated SC-203 and new Minimum Operational Performance specs, and FAA got rid 
of their SSI-related objective. Changes re being accounted for via KDP planning for Phase 2. Present mitigations remain 
effective. 

6/12/12: Established monthly meetings with FAA UAS Integration office 
4/12/12: Risk baselined 

3/9/12: Risk brought to RMB. Action given to reword and bring back to RMB. 

1/31/12: Risk brought to RMB as a Candidate Risk but deferred for further discussions if this should be a Project or Program risk. 

Risk Action: Mitigate 

Mitigation Trigger (if current action is Watch): When external efforts that could result in possible changes to UAS-NAS 
scope are on-going. 


Impact 

Planned activities in the UAS-NAS Project may not be 
relevant, resulting is significant project replanning. 


Rationale for Closure: 
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UAS-NAS Project Focus Changes Due to External 
Influences 



Risk ID: 02 


Trend 



Criticality 

Med 


Current L x C 

2x3 

(Technical = 3, 
Schedule = 3, 
Cost = 3) 

Open Date 

4/12/12 

with 

3x3 


Planned 
Closure Date 

7/1 5/1 6 


Risk Statement 

Discussions between NASA, FAA and others in the UAS community 
were used to identify project Technical Challenges, which were used 
to scope project content during Formulation. These activities 
continue to refine the UAS integration in the NAS efforts at the 
national level through roadmap development. While IASP and the 
UAS-NAS Project participate in these activities, resultant changes to 
the UAS roadmap could lead to changes in UAS-NAS Project 
content. This risk captures the potential for loss of relevance of UAS- 
NAS work content and the potential that stakeholder/customer needs 
might change. 


Impact 

Planned activities in the UAS-NAS Project may not be 
relevant, resulting is significant project replanning. 


Mitigation Step/Task Description: 

Cost to 
Implement 

Start 

Date 

End Date 

New 

LxC 

Remain involved with major policy making, shareholder, and stakeholder 
organizations (FAA-UAS-PO, RTCA SC-228, DoD, MIT-LL, AFRL, etc.)- Gain 
FAA agreement on NASA body of research/technology developments. 

$0 


End of 
Project 

2x3 

Remain cognizant of FAA and JPDO roadmapping efforts to provide insight to 
FAA and JPDO thinking on research and technology development needs. The 
delivery date for these roadmaps is unknown so the mitigation will end upon 
publication. 

$0 


Closed 

11/7/13 

2x3 

Remain cognizant of FAA integration efforts to provide insight to FAA thinking on 
research and technology development needs. 

$0 


End of 
Project 

2x3 

Participation in the RTCA SC-228 working groups, SARP, UAS Senior Steering 
Group of ExCom, and UAS Aviation Rulemaking Committee. 

$0 


Release of 
Final 
MOPS 
7/1 5/16 

2x3 
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Project Success 
Risk ID: 

U. 1.1. 12 
Risk Owner: 

Grindle 

Project 

Trend 


Criticality 


Current L x C 

3x5 

(Technical = 5, 
Schedule = 3, 
Cost = 1 ) 

Target L x C 

3x3 

Open Date 

10/16/14 

with 

3x5 

Planned 
Closure Date 

12/31/2015 



RTCA SC-228 Req"i r ements Development Delay 

' A ’ ^ j Jm Q 1 

I...Dact 



Risk Statement 

Given the DAA and C2 WG are continuing to refine the 
requirements and V&V plans, and given the project 
technical objectives and schedule have been baselined 
there is a possibility the requirements they define will 
impact the project baseline technical objectives and 
schedule. As an example the CNPC radio, originally 
designed to SC-203 seedling requirements, continues to 
be refined based on developing C2 MOPS. 



Technical = 5; The UAS-NAS Project technical baseline is aligned with 
anticipated SC-228 MOPS needs. Unknown whether the baseline plan will be 
consistent with undelivered MOPS and V&V plans if they are delivered late to 
ToR schedule. 

Schedule = 3; minimum impacts LI milestones (NASA feedback to the MOPS). 
Cost = 1; Project would be met per baseline cost. 

*** Note: Assumed SC-228 Preliminary MOPS slip impacts planning and 
execution of FT4 


Status: 5/21/15: MRB approved moving risk to watch status. Risk was TOP RISK -due to original LxC score 3x5 (red). No longer a 

top risk due to watch status. 


5/19/15: During PPBE 17 the Project provided ARMD/IASP with a proposed follow-on project which would decrease the likelihood. The 
Project has done everything it can do until this risk is triggered. Mitigations are actively being worked. If risk is triggered then 
approved contingency plan will be implemented. Proposed to move into watch status. Trigger will be RTCA SC-228 schedule delay. 

4/13/15: Project Office Risk Workshop held. Received action at IASP/UAS RMB on April 9 th to review scores. Examined LxC scores and 
the likelihood of 3 is consistent with information from WG meetings in the absence of something more definitive from leadership. The 
consequence score reflects impact of not completing the technical challenge. 


Risk Approach: Watch 

Mitigation Trigger (if current action is Watch):The trigger is RTCA SC-228 schedule delay. 


Mitigation Step/Task Description: 

Cost to 
Implement 

Start 

Date 

End Date 

New LxC 

Integrate NASA personnel into SC-228 C2 working groups to understand 
and influence C2 WG requirements and their impacts on the Flight Test 
planning, and share C2 research, objectives, plans, and results with C2 
WG. (Mitigation 01) [Griner] 

$0 

9/5/14 

12/31/15 

3x3 

C (T3, S3, Cl) 

Integrate NASA personnel into DAA working groups to understand and 
influence DAA MOPS requirements and their impacts on the Flight Test 
planning (Mitigation 02) [Arthur/Santiago] 

$0 

9/5/14 

12/31/15 

3x3 

C (T3, S3, Cl) 

Contingency Plan - Project Controlled Contingency Plan on next slides. 

- Word Document located on KN at https://nsckn.nasa.gov/DMS/ViewDoc. aspx?DoclD=743920 

- IASP Controlled Contingency Plan captured in mitigation below 

Work towards extending the life of the Project or including 
appropriate Project personnel in another ARMD activity to 
support the SC-228 Phase 2 MOPS. 
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RTCA SC-228 Requirements Development Delay 
Contingency Plan (1 of 2) 



Risk ID 1.1.12. Risk Statement Given the SC-228 detect and avoid (DAA) and command and control (C2) Data Link Working 
Groups (WG) are continuing to develop their Minimum Operational Performance Standards (MOPS) and MOPS verification 
and validation (V&V) plans, and given the project technical objectives and schedule were baselined to reasonably support the 
published SC-228 schedule, there is a possibility that potential changes to the MOPS or V&V plans development schedules or 
requirements will impact the project baselined technical objectives and schedule. 


As an example the UAS-NAS project is developing a prototype control and non-payload communication (CNPC) radio for use in 
MOPS development and MOPS V&V. A CNPC radio is one of several key technologies required for MOPS development and 
MOPS V&V. As CNPC radios take several years to design and build the NASA CNPC prototype radio design was initiated with 
RTCA SC-203 seedling requirements. While the design of the radio continues to mature, there is risk that changes in C2 
Working Group MOPS may not be implementable in the CNPC radio design if they are too extensive or require more schedule 
than is available within the UAS-NAS Project. 


Background: RTCA SC-228 is the primary stakeholder to the majority of the Project's research portfolio. The SC-228 Terms of 
Reference (TOR) defined requirements with respect to developing MOPS for DAA, and C2. The requirements included 
producing Preliminary MOPS and a MOPS V&V Plan by July 2015 (Phase One), and Final MOPS based on the MOPS V&V by 
July 2016 (Phase Two). The two phases of SC-228 are unrelated to the two phases of the UAS-NAS Project. Both DAA and C2 
have independent working groups defining MOPS for the respective technology areas. The working groups each have 
elements of Human Systems Integration embedded. NASA's research activities contribute to developing Preliminary MOPS, 
supporting MOPS V&V, and developing Final MOPS for each respective Working Group. The technology transfer process for 
NASA research findings described below will be relevant to MOPS development Phase 1 only, UAS-NAS Project Phase 2. 


The UAS-NAS Project baselined milestone dates are generally aligned with the SC-228 MOPS delivery dates. The risk is 
whether the UAS-NAS Project's baseline technology transfer of research findings plan can support MOPS development and 
MOPS V&V plans if the results from those efforts are delayed later than the Project can adapt or when delivered the results 
are significantly different from the UAS-NAS initial assumptions. 

NASA is participating in SC-228 at all levels. 

• From a project management level the UAS-NAS Project is coordinating a strategy for documenting deliverables to SC-228. 
Laurie Grindle, Davis Hackenberg, and Debra Randall attend the Plenary sessions to maintain awareness at a high level. 

• NASA is a key contributor at the working group level to within several sub working groups. Project participation in the SC- 
228 working groups by the subproject PE's (Confesor Santiago, Maria Consiglio, Jay Shively, Jim Griner) provides a method 
of influencing MOPS requirements and feeding back SC-228 discussions into UAS-NAS Project plans. 



RTCA SC-228 Requirements Development Delay 

Contingency Plan (2 of 2) 



Risk ID 1.1.12. Contingency Plan: Assuming the RTCA SC-228 Preliminary and Final MOPS delivery schedules slip or the MOPS 
or MOPS V&V Plans are substantially different from initial Project assumptions the UAS-NAS Project may not be able to adapt 
based upon Project currently baselined Level 1 and Level 2 Milestones. 


Assumptions: 

1) Next FY President's Budget includes the extension of funding to the first quarter of FY17. 

2) No additional funding available for changes to the Project baseline within baselined project completion date of Sep 30, 
2016 (EOFY16). 

3) No additional funding available to extend the Project beyond the first Quarter of FY17. 

The following general scenarios are possible and provided for potential contingency plan discussions: 


If 

Then 

Potential Impact to Project Cost, 
Schedule, Technical Baseline 

Potential Impact to SC-228 

All SC-228 changes to 
MOPS or MOPS V&V Plan 
can be accommodated 
within Project Cost 
Baseline (that includes the 
one quarter funding 
extension) 

Project accommodates 
changes by moving 
Milestones or modifying 
Technical Baseline 

• Cost: 1, funded with already approved one 
quarter extension 

• Schedule: 5, potential up to 3-month slip to 
Project Level 1 or 2 Milestones 

• Technical Baseline: 4, potential moderate 
impact to objective, technical challenge, or 
technology maturation 

• None 

• Consequence = 1 

Some of SC-228 changes 
to MOPS or MOPS V&V 
Plan can be 
accommodated within 
Project Cost Baseline (that 
includes the one quarter 
funding extension) 

Project accommodates 
those changes it can by 
moving Milestones or 
modifying Technical 
Baseline, but not 
incurring costs approved 
the approved cost 
baseline (that includes 
the one quarter funding 
extension) 

• Cost: 1, funded with already approved one 
quarter extension 

• Schedule: 5, potential up to 3-month slip to 
Project Level 1 or 2 Milestones 

• Technical Baseline: 4, potential moderate 
impact to objective, technical challenge, or 
technology maturation 

• Some Project results delivered 
per changed Project baselined 
schedule and Technical 
Baseline do not meet SC-228 
MOPS or MOPS V&V Plan 
needs 

• Consequence = 2-4 

SC-228 changes to MOPS 
or MOPS V&V Plan cannot 
be accommodated within 
Project Cost Baseline (that 
includes the one quarter 
funding extension) 

Project does not change 
Baseline Milestone 
Schedule or Technical 
Baseline 

• None as the Project does not make any 
changes to approved Schedule Baseline or 
Technical Baseline 

• Project results delivered per 
Project baselined schedule and 
Technical Baseline do not meet 
SC-228 MOPS or MOPS V&V 
Plan needs 

• Related to risk U. 1.1. 10 Output 
from Test Events has value to 
Project Stakeholders 

• Consequence = 5 




TC-C2: Risk Matrix and Summary 




Risk 

ID 

Trend 

LxC 

Target 

LxC 

Approach 

Risk Title 

4.3.5 

■=> 

3x3 

2x1 

M 

Additional Spectrum 
Analysis Requirements 

5.1.17 

NA 

1x3 

2x2 

W 

The T-34 (UA Surrogate) 
for FT3 and FT4 may not 
be available 


As of 9/30/15 


• Changes Since 2014 Annual Review 

- Added 3 Risks (4.3.9, 4.3.10, 4.3.11) 

- Closed 6 Risks (4.3.2, 4.3.4, 4.3.6, 4.3.9, 
4.3.10, 4.3.11) 

- Moved risk 5.1.17 from TC-IT&E to TC-C2 



L x C Trend 

XI Decreasing (Improving) 
Increasing (Worsening) 
□l) Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA- Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 
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TC-SAA: Risk Matrix and Summary 



Risk 

ID 

Trend 

LxC 

Target 

LxC 

Approach 

Risk Title 

4.1.11 

(T) 

■=> 

3x3 

2x2 

M 

Validation of SAA Sensor 
Models 

4.1.9 

>=> 

2x3 

1x3 

M 

Delay of SAA/SSI 
Technology Developments 
Impact to 

Integrated Test Events 
(IHITL, FT3 and FT4) 

4.1.10 

NA 

2x2 

2x2 

W 

Completion of SAA/SSI 
Technical Objectives that 
Rely upon Formal 
Partnerships 


As of 9/30/15 


• Changes Since 2014 Annual Review 
- Closed 2 Risks (4.1.7, 4.1.8(T)) 



L x C Trend 


XI Decreasing (Improving) 
Increasing (Worsening) 
□l) Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA- Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 
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TC-HSI: Risk Matrix and Summary 



Risk Matrix 




L x C Trend 

XI Decreasing (Improving) 
Increasing (Worsening) 
□l) Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA- Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 


Risk 

ID 

Trend 

LxC 

Target 

LxC 

Approach 

Risk Title 

4.2.9 


3x3 

lxl 

M 

Delay of HSI Technology 
Development Impact to 
Integrated Test Events 
(IHITL, FT3 and FT4) 

4.2.8 


2x2 

2x2 

M 

Endorsement of HSI GCS 
Guidelines from a 
Recognized Standards- 
based Group 

4.2.11 

>=> 

1x3 

1x3 

M 

Availability of Vigilant 
Spirit Control Station 
for Flight Test Series 

4.2.10 

NA 

2x2 

2x2 

W 

Completion of HSI 
Technical Objectives that 
Rely upon Formal 
Partnerships 


As of 9/30/15 


• Changes Since 2014 Annual Review 

- Closed 1 Risk (4.2.12) 

- Moved 1 Risk to Watch (4.2.10) 
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TC-ITE: Risk Matrix and Summary 



Risk 

ID 

Trend 

LxC 

Target 

LxC 

Approach 

Risk Title 

5.1.23 

0 

3x4 

lxl 

M 

No formal agreement in 
place to access 
Honeywell data fusion 
algorithm 

5.1.11 

(T) 

■=> 

3x3 

1x3 

M 

Required Assets for Flight 
Test 4 (FT4) not available 
during test period 

5.1.8 

(T) 

<=> 

2x3 

1x3 

M 

Distributed Test 
Environment 
requirements for 
Integrated Flight Test 4 
(FT4) not defined 


As of 9/30/15 





L x C Trend 

XI Decreasing (Improving) 
Increasing (Worsening) 
□l) Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA- Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 


• Changes Since 2014 Annual Review 

- Added 3 Risks (5.1.25, 5.1.26, 5.1.27) 

- Closed 9 Risks (5.1.7(T),5.1.10, 5.1.16, 5.1.21, 
5.1.22, 5.1.24, 5.1.25, 5.1.26, 5.1.27 ) 
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Certification Risk Matrix and Summary 




Risk 

ID 

Trend 

LxC 

Target 

LxC 

Approach 

Risk Title 

4.4.5 

NA 

2x3 

1x2 

W 

Availability of Designated 
Engineering 
Representatives 
Resources 


As of 9/30/15 


• Changes Since 2014 Annual Review 
- Moved 1 Risk to Watch (4.4.5) 



L x C Trend 

XI Decreasing (Improving) 
Increasing (Worsening) 
□l) Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA- Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 
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Project Management Risk Matrix and Summary 


Risk Matrix 




1.1.11 





IASP 02 
1.1.10 





1.1.14 

1 

2 

3 

4 


CONSEQUENCE 



L x C Trend 


Approach 

XI Decreasing (Improving) A- Accept RA - Raise 

Increasing (Worsening) M - Mitigate E- Elevate 
Cl) Unchanged 

(T) Indicates a Top Risk 


W - Watch 
R- Research 


C- Close 



Risk 

ID 

Trend 

LxC 

Target 

LxC 

Approach 

Risk Title 

IASP 
02 (T) 

■=> 

2x3 

lxl 

M 

Project Focus Changes 
Due to External 
Influences 

1.1.10 

(T) 

if 

2x3 

2x3 

M 

Output from Test Events 
has value to Project 
Stakeholders 

1.1.11 

■=> 

3x2 

1x2 

M 

Lack of Definition for 
Capstone 

1.1.14 

■=> 

4x1 

2X1 

M 

Capstone Partnership 
Development and 
Formalization 

1.1.12 

(T) 

NA 

3x5 

3X3 

W 

RTCA SC-228 
Requirements 
Development Delay 


Changes Since 2014 Annual Review 

- Added 1 Risk (1.1.14) 

- Accepted 1 Risk (1.1.7) 

- Closed 1 Risk (1.1. 4(T)) 

- Moved 1 Risk to Watch (1.1.12 ) 


As of 9/30/15 
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Risks Accepted/Closed (1 of 3) 



Risk ID 

Project/ 

TC 

Risk Title 

Date 

Closed 

Closing Rationale 

U.4.3.2 

C2 

Communication Security 
Requirements Exceed CNPC Link 
Constraints 

4/23/15 

All mitigations are complete reducing the LxC to target 
score of 1x3. Comm team has worked with Rockwell 
Collins and RTCA to approve data rates for 
communication link. All security functions needed are 
being handled by that data rate. 

U.4.3.4 

C2 

Availability of OPNET Modeler 
Expertise 

12/18/14 

Mitigations are complete resulting in a LxC score of 1x2. 
Contractor has been hired on and trained. There is no 
longer an issue in this area. 

U.4.3.6 

C2 

Higher Communications Aircraft 
Fuel Cost 

9/24/15 

As FT3 has concluded and GRC aircraft are not being 
used in FT4, there is no further basis for this risk. 

U.4.3.9 

C2 

FT3 CNPC Preparations Stressing 
C2 Preliminary MOPS 
Development 

9/24/15 

As both the preliminary C2 MOPS and FT3 have been 
completed, there is no longer a basis for this risk. 

U.4.3.10 

C2 

FT3 Radio Frequency Coverage 

9/24/15 

Mitigation 2 was completed, indicating the frequency 
coverage for FT3 was adequate. FT3 has been 
completed, and there is no longer a basis for this risk 

U.4.3.11 

C2 

FT3 CNPC Equipment Installation 
at California 

9/24/15 

Installation of FT3 CNPC equipment was installed at a 
single alternate site at AFRC. As FT3 has been 
completed, there is no longer a basis for this risk. 

U.4.1.7 

SAA 

Lack of Collision Avoidance Model 
Availability and Integration 
Support 

4/21/15 

All mitigations are complete reducing the LxC to target 
score of 1x3. SAA integrated TCAS II model and is using 
it fortesting. 

U.4.1.8 

SAA 

Sense and Avoid Sensor Suite 
Availability 

12/18/14 

All mitigations are complete resulting in a target LxC 
score of 2x2. Partnership with GA is established and 
plans are in place to equip Ikhana. 137 




Risks Accepted/Closed (2 of 3) 



Risk ID 

Project/ 

TC 

Risk Title 

Date 

Closed 

Closing Rationale 

U.4.2.12 

HSI 

New Requirements associated 
with HSI Part Task 5 

12/18/14 

Additional WYE has been hired. Mitigation 01 is 
complete, reducing the LxC from 4x3 to 2x2 

U.5.1.7 

ITE 

Distributed Test Environment 
requirements for Integrated 
Flight Test 3 (FT3) not defined 

3/26/15 

The Flight Test 3 requirements have been gathered and 
vetted through the System Requirements Review, 
presented to our stakeholders for comment, and 
finalized at the Final Design Review. All Mitigations have 
been successfully completed. 

U. 5. 1.10 

ITE 

Required Assets for Flight Test 3 
(FT3) not available during test 
period 

8/20/15 

FT3 deemed complete on 8/13/2015. 

U. 5. 1.16 

ITE 

Completion of TC6/IT&E Technical 
Objectives that Rely upon Formal 
Partnerships 

4/23/15 

GA Space Act Agreement with NASA has been signed. 
Any required modifications are being tracked by the 
Project Office. Mitigations tracked by IT&E have been 
successfully completed. 

U. 5. 1.21 

ITE 

Aggressive ACAS-Xu Flight Test 
Schedule Jeopardizes Full Success 
Criteria 

1/27/15 

All mitigations were implemented successfully to 
complete the ACAS-Xu CA flight testing on time. 
Although the AFSR schedule was impacted by 1 week, 
close coordination with the FRR Board Members 
resulted in an uneventful AFSR Review and subsequent 
flight test approval. 

U. 5. 1.22 

ITE 

Compressed AFSR Schedule 
Results in Schedule Delay 

12/18/14 

All mitigations were implemented successfully to 
complete the ACAS-Xu CA flight testing on time. 
Although the AFSR schedule was impacted by 1 week, 
close coordination with the FRR Board Members 
resulted in an uneventful AFSR Review and subsequent 
flight test approval. 




Risks Accepted/Closed (3 of 3) 



Risk ID 

Project/ 

TC 

Risk Title 

Date 

Closed 

Closing Rationale 

U. 5. 1.24 

ITE 

Timing of Part Task 5 impact on 
Flight Test 3 design 

4/23/15 

The Flight Test 3 design has been reviewed and finalized 
at FDR. All mitigations were completed and the system 
is on track for data collection. 

U. 5. 1.25 

ITE 

Shortage of Resources - AFRC IT 
Security Experts 

7/23/15 

Full ATO signed on June 29. ATO was granted to the 
Ikhana project. Risk has been fully mitigated reducing 
the LxC to target score of 1x4 (green). 

U. 5. 1.26 

ITE 

ADS-B Receiver may not be 
received in time to support FT-3 

8/20/15 

A second receiver is scheduled to be delivered 8/17. 

The first receiver will be repaired prior to FT4 and will be 
used as a backup. Given FT4 is six months away, IT&E 
does not consider this a risk. 

U. 5. 1.27 

ITE 

FT-3 Ikhana and Intruder Pilot 
Availability 

8/20/15 

FT3 deemed complete on 8/13/2015 

U. 1.1.4 

PO 

The predicted or projected UAS 
mission profiles and traffic 
estimates used by the subprojects 
for their technology development 
efforts may not be realistic or 
accurate. 

3/26/15 

All mitigations are complete resulting in a target LxC 
score of 1 x 3. 

U. 1.1.7 

PO 

Negative Public Perception of UAS 
in NAS 

12/18/14 

Accepted 

All mitigations are captured in the UAS-NAS Public 
Outreach plan reducing the LxC to 2x3. Outreach tasks 
have been added to the IMS. Project has allocated a set 
amount of resources and feel that is the limit to what 
we want to contribute to influence the public's opinion. 
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Risk Process 

• Risk Management 

- Utilizes a Continuous Risk Management (CRM) process 
to identify, analyze, plan, track, and control risks 

• Risk Workshops and Risk Review meetings conducted 
monthly 

• Integrated Test & Evaluation Subproject holds a weekly 
risk working group meeting to address their risks 



or 

o 

2 



Communicate 

Document 




— Risks are communicated in IASP UAS-NAS Risk Review 
Board, AFRC & Partner Center CMCs 

Path Forward to address Process Failure 


Identify 

Identify risk issues and concerns 


- To gain higher perspective, Project 
Manger and Management Support 
Specialist will implement 
monthly risk brainstorming meeting to 
review concerns and discuss any 
potential new concerns/candidate 


Risk data: test data, 
expert opinion, 
technical analysis 


Resources 




Center/Program/Project date 
(metrics information) 




Analyze 

Evaluate and classify risks 


Plan 

Decide what, if anything, should 
be done about risks 


Track 

Monitor risk metrics and 
verify/validate mitigation actions 


Concerns and Candidate 
risks identified and 
documented on Project risk 
form and/or risk tracking 
^spreadsheet 

Risk Review Meetings and 
Workshops to analyze risk 
based upon likelihood and 
consequence (LxC) 

Accept 
Mitigate 
Watch 
Research 
Raise* 

Elevate 
Close 

Risk status reports including: 

• LxC score 

• Change in trend 


Control 

Risk decisions 


T- 


Risk decisions 


risks 


Note: Communication and documentation extend throughout all functions. 
*Raise: unique to UAS-NAS Project 
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UAS-NAS Risk Summary Card 


LIKELIHOOD 

5 

Very High 

Qualitative: Nearly certain to occur. 

Controls have little or no effect. 

4 

High 

Qualitative: Highly likely to occur. 

Controls have significant uncertainties. 

3 

Moderate 

Qualitative: May OCCUr. 

Controls exist with some uncertainties. 

2 

Low 

Qualitative: Not likely to occur. 

Controls have minor limitations /uncertainties. 

1 

Very Low 

Qualitative: Very unlikely to occur. 

Strong Controls in Place 






CONSEQUENCE 

i 

2 

3 

4 

5 

Technical 

Negligible Impact to 
Objective, Technical 
Challenge, 
Technology 
Maturation 

Minor Impact to 
Objective, Technical 
Challenge, Technology 
Maturation 

Some Impact to Objective, 
Technical Challenge, 
Technology Maturation 

Moderate Impact to Objective, 
Technical Challenge, 
Technology Maturation 

Major Impact/Cannot Complete 
to Objective, Technical 
Challenge, Technology 
Maturation 

Cost 

< 1% Total Project 
Yearly Budget 
(< $300K) 

1% - 5% Total Project 
Yearly Budget 
($300K-$1.5M) 

5% - 10% Total Project Yearly 
Budget 
($1.5M -$3M) 

10% - 15% Total Project 
Yearly Budget 
($3M - $4.5M) 

>15% Total Project Yearly 
Budget 
( > $4.5M) 

Schedule * 

Level 2 Milestone(s): 
< 1 month impact 

Level 2 Milestone(s): 
> 1 month impact 

Level 1 Milestone(s): 
<1 month impact 
Level 2 Milestone(s): 
< 2 month impact 

Level 1 Milestone(s): 

> 1 month impact 
Level 2 Milestone(s): 

> 2 month impact 

Level 1 Milestone(s): 

> 2 month impact 
Level 2 Milestone(s): 

> 3 month impact 


Note: LI = ISRP L2 = Project 
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Project Level Performance 
Backup Slides 


192 



Reserve Strategy 
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Resource Allocation FY16 Budget 
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FY15 Project Deliverables 



Phase 2 Technical Challenge Deliverables - SAA 

Date 

Type of 
Deliverable 

Completed, Ongoing, and Upcoming Experiments IHITL/B747-TCAS and IHITL/CAS2 Overview and Results 

Nov-14 

Briefing 

Pilot Detect-and-Avoid Evaluation 

Nov-14 

Briefing 

Investigating the Impacts of a Separation Standard for UAS Enroute and Transition Airspace 

Nov-14 

Paper 

UAS CAS3 CASSAT PER/FER 

Mar-15 

Briefing 

Fast Time Simulation Studies 

May-15 

Briefing 

Detect and Avoid Research 

May-15 

Briefing 

Characterizing the Effects of a Vertical Time Threshold for a Class of Well-Clear Definitions 

May-15 

Paper 

Appendix A NAS wide evaluation using historical radar data and airspace 

May-15 

Paper 

UAS in the NAS Air Traffic Controller Acceptability Study - 1 the Effects of Horizontal Miss Distances on 
Simulated UAS and Manned Aircraft Encounters 

May-15 

Briefing & Paper 

UAS Air Traffic Controller Acceptability Study 2 - Effects of Communications Delays and Winds in Simulation 

May-15 

Paper 

Airspace Safety Threshold Study- NAS-wide Encounter Rate Evaluation using Historical Radar Data and ACES 

May-15 

Briefing 

Analysis of Baseline PT5 Alerting Scheme in Fast-Time Simulations without DAA Mitigation 

May-15 

Briefing 

Characteristics of a Well Clear Definition and Alerting Criteria for Encounters between UAS and Manned 
Aircraft in Class E Airspace 

Jun-15 

Paper 

DAIDALUS: Detect and Avoid Alerting Logic for Unmanned Systems 

Sep-15 

Paper 

HITL Experimental Research for DAA 

Sep-15 

Briefing 

Detect and Avoid Alerting Logic for Unmanned Systems 

Sep-15 

Briefing 
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FY15 Project Deliverables 



Phase 2 Technical Challenge Deliverables - C2 

Date 

Type of 
Deliverable 

Gen-4 and Gen-5 Radio Plans 

Dec- 14 

Briefing 

V & V Update 

Dec- 14 

Briefing 

CNPC Prototype Gen 2 Security Architecture Lab Test Report 

Dec-14 

Report 

Security Risk Assessment Process for UAS in the NAS CNPC Architecture 

Aug-13 

Report 

CNPC System Development and Testing 

Apr-15 

Briefing 

CNPC Prototype Radio - Gen 2 Security Architecture Lab Test Report 

Jun-15 

NASA TM 

Phase 2 Technical Challenge Deliverables - HSI 

Date 

Type of 
Deliverable 

Measured Response The effect of GCS Control Mode Interfaces on Pilot Ability to Comply with ATC 
Clearances 

Oct-14 

Briefing 

A report on the Human Systems Integration Phase 1 Activities 

Oct-14 

Briefing 

IHITL: Detect and Avoid Display Evaluation Prelim Results 

Nov-14 

Briefing 

HSI Display Evaluation Overview 

Mar-15 

Briefing 

NASA's UAS Integration into the NAS: A Report on the Human Systems Integration Phase 1 Simulation 
Activities 

May-15 

Briefing 

Human Performance Issues in Remotely Piloted Aircraft Systems 

Mar-15 

Briefing 

Automation in Unmanned Aerial Vehicles 

Mar-15 

Briefing 

Part Task 5 Detect and Avoid Display Evaluation Overview III 

May-15 

Briefing 

An Evaluation of DAA Displays for Unmanned Aircraft Systems The Effect of Information Level and Display 
Location on Pilot Performance 

May-15 

Paper 

UAS-NAS Part Task 5 Detect and Avoid Display Evaluation Primary Results 

May-15 

Briefing 
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FY15 Project Deliverables 



Project Phase 2 Technical Challenge Deliverables - HSI Continued 

Date 

Type of 
Deliverable 

UAS-NAS DAA Display Evaluation in Support of SC-228 MOPS Development 

Jun-15 

Briefing 

An examination of UAS Pilots Interaction with ATC while responding to DAA Conflicts 

Jun-15 

Paper 

Project Phase 2 Technical Challenge Deliverables - ITE 

Date 

Type of 
Deliverable 

RUMS- Real-time Visualization and Evaluation of Live Virtual, Constructive Simulation Data 

Jan-15 

Paper 

Message Latency Characterization of a Distributed Live, Virtual, Constructive Simulation Environment 

Jan-15 

Paper 

IHITLTest Environment Report 

Mar-15 

Report 

Project Overview and A distributed environment for testing UAS concepts 

May-15 

Briefing 

FT3 Test Plan - Rev E 

Jul-15 

Report 

FT4 Test Requirements 

Aug-15 

Report 

Project Phase 2 Technical Challenge Deliverables - Non-TC Certification 

Date 

Type of 
Deliverable 

Mock Type Certification Basis for an Unmanned Rotorcraft for Aerial Application Operations 

Mar-15 

Paper 

A Case Study for Assured Containment 

May-15 

Paper 

Mock Certification Basis for an Unmanned Rotorcraft for Precision Agricultural Spraying 

Sep-15 

Paper 

Project Phase 2 Technical Challenge Deliverables - Non-TC sLIAS 

Date 

Type of 
Deliverable 

sUAS Flight Experiments for Great Dismal Swamp Fire Detection 

Dec- 14 

Paper 
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Technology Transfer Coordination 
(UAS-NAS to Stakeholder) 



Monthly/Quarterly Coordination 


Daily/Weekly Coordination 




Stakeholder 

Working 

Groups 


• SC-228 


UAS TWP 
Integrated 
Events 


/V 


V. 


Sub WG Planning 
Key Issues Resolution 
Technical Exchange 
Briefings 


SC-228 

OSD SAA SARP 
FAA UAS Int. Office 




Stakeholder 
Face to Face 
Meetings 


Cross WG Planning 
Key Issues Resolution 
Results Validation 
Briefings 


Annual Coordination 


• SC-228 

• OSD SAA SARP 


• FAA UAS Integration Office 

• ITU-R 




Stakeholder & 
Project Annual 
Meetings 


Strategic Planning 
Project Annual Meetings 
Professional Annual Meetings 
Final Reports/Presentations 


RTCA SC-228 

• Baseline PRD Content 

• Initial Tech Transfer Briefings 

• Final Reports ^ — 

FAA 

• Test Plans 

• Final Reports 

OSD SAA SARP 


Formal UAS-NAS 


Formal Stakeholder 

Project 

/ \ 

Deliverables 

Deliverables to 

N / 

Influence 

Stakeholders 


UAS-NAS 


• Research Findings 

ITU-R 

• Spectrum Analysis 


• Transfer Method 

- Publicly releasable material: NASA ARMD Website 

- Controlled data, e.g. ITAR: Secure email/server/website 


RTCA SC-228 

• White Papers 

• Preliminary & Final MOPS 

FAA 

• Integration Road Maps 

• Rules and Regulations 

OSD SAA SARP 

• Recommendations 

ITU-R 

• Authorization 
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Project Office 




Project Level 

Comprehensive Reports 
API 

RTCA SC-228 MOPS 

SC- 226 DAA MOPS 
SC-226 C2 MOPS 


FY2014 

FY2015 

FY2016 

Ql 

Q2 

w 

Q4 

Ql 

Q2 

Q3 

Q4 

Ql 

Q2 

Q3 

Q4 








API 


LI Program (I ASP) 


L2 Project 


Green Status Line Date 9/30/15 
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Current Active Collaborations/Partnerships Status - 

FAA Test Sites 



Area 

FAA Test 
Site 

Partner 

POCs 

Agreement 
In Place 

In 

Execution 

Collaboration/ Partnership Role 

TC-ITE 

University of 

Alaska 

Fairbanks 

Ro Bailey 

s 

Contract 

s 

Support of Task 1, UTM and support of 
Task 2. LVC-DE efforts 

TC-ITE 

State of 
Nevada 

Thomas 

Wilczek 

Contract 


Support of Task 1, UTM and support of 
Task 2. LVC-DE efforts 

TC-ITE 

New York- 
Griffiss UAS 
Test Site 

Chad 

Lawrence 

Contract 


Support of Task 1, UTM and support of 
Task 2. LVC-DE efforts 

TC-ITE 

North 
Dakota - 
Northern 
Plains Test 
Site 

Robert 

Becklund 

S 

Contract 


Support of Task 1, UTM and support of 
Task 2. LVC-DE efforts 

TC-ITE 

Texas A&M 
University 

Dr. Luis 
Cifuentes 

S 

Contract 

s 

Support of Task 1, UTM and support of 
Task 2. LVC-DE efforts 

TC-ITE 

Virginia Tech 

John Rudd 

V 

Contract 


Support of Task 1, UTM and support of 
Task 2. LVC-DE efforts 
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Acronym List 


AA 

Associate Administrator 

ACAS 

Airborne Collision Avoidance System 

ACES 

Airspace Concept Evaluation System 

ADS-B 

Automatic Dependent Surveillance Broadcast 

AFRC 

Armstrong Flight Research Center 

AFRL 

Air Force Research Lab 

AFSRB 

Airworthiness and Flight Safety Review Board 

AIAA 

American Institute of Aeronautics and Astronautics 

AOSP 

Airspace Operations and Safety Program 

APG/I 

Annual Performance Goal/Indicator 

ARC 

Ames Research Center/Aviation Rule Making Committee 

ARD 

Aeronautics Research Director 

ARMD 

Aeronautics Research Mission Directorate 

ASRS 

Aviation Safety Reporting System 

ATC 

Air Traffic Controller 

ATO 

Air Traffic Organization-FAA Organization 

ATOL 

Air Traffic Operations Lab 

AUVSI 

Association for Unmanned Vehicle Systems International 

BLOS 

Beyond Line of Sight 

BVLOS 

Beyond Visual Line of Sight 

C2 

Command and Control 

CA 

Collision Avoidance 

CAS 

Collision Avoidance System 

CAT 

Collision Avoidance Threshold 


Acronym List 


CDP 

Content Decision Process 

CDR 

Critical Design Review 

CIO 

Chief Information Officer 

CM 

Change Management or Contingency Management 

CMC 

Center Management Council 

CNPC 

Control and Non-Payload Communications 

COA 

Certificate of Waiver or Authorization 

COE 

Center of Excellence 

ConOps 

Concept of Operations 

CPA 

Closest Point of Approach 

CPDS 

Conflict Prediction and Display System 

CR 

Change Request 

CRM 

Continuous Risk Management 

CSD 

Cockpit Situation Display 

CSUN 

Cal State University Northridge 

CTD 

Concepts and Technology Development Project 

DAA 

Detect and Avoid 

DAIDALUS 

Detect and Avoid Alerting Logic for Unmanned Systems 

DER 

Designated Engineering Representative 

DoD 

Department of Defense 

DPM 

Deputy Project Manager 

DPMf 

Department PM for 

EAFB 

Edwards Air Force Base 

EIP 

Early Implementation Plan 

EL 

Elevation 


Acronym List 


EO 

Electro Optical 

ERT 

Engineering Review Team 

ExCom 

UAS Executive Committee 

FAA 

Federal Aviation Administration 

FAR 

Federal Aviation Regulations 

FL 

Flight Level 

FRR 

Flight Readiness Review 

FSS 

Fixed Satellite Service 

FT 

Flight Test 

FTE 

Full Time Equivalent 

FY 

Fiscal Year 

GA 

General Aviation 

GA-ASI 

General Atomics Aeronautical Systems Inc. 

GCS 

Ground Control Station 

GDS 

Great Dismal Swamp 

GRC 

Glenn Research Center 

GSN 

Goal Structuring Notation 

HCII 

Human Computer Interaction International 

HF 

Human Factors 

HITL 

Human-ln-The-Loop 

HLA 

High Level Architecture 

HMD 

Horizontal Miss Distance 

HSI 

Human Systems Integration Subproject 

IAA 

Inter-Agency Agreement 


Acronym List 


IAI 

Intelligent Automation Inc. 

IASP 

Integrated Aviation Systems Program 

ICAO 

International Civil Aviation Organization 

ICAST 

Inter Center Autonomy Study Team 

IFR 

Instrument Flight Rules 

IH 

In House 

IHITL 

Integrated Human-ln-The-Loop 

IMS 

Integrated Master Schedule 

10 

Integration Office 

IPO 

Inter-agency Planning Office 

IR 

Infrared 

IRP 

Independent Review Panel 

ITAR 

International Traffic in Arms Regulations 

IT&E 

Integrated Test and Evaluation Subproject 

ITU-R 

International Telecommunication Union-Radiocommunication Sector 

KDP 

Key Decision Point 

LI 

Level 1 

12 

Level 2 

LaRC 

Langley Research Center 

LOS 

Line of Sight 

LSTAR 

Lightweight Surveillance and Target Acquisition Radar 

LSUASC 

Lone Star UAS Center of Excellence 

LVC 

Live Virtual Constructive 

LVC-DE 

Live Virtual Constructive Distributed Environment 


Acronym List 


MACS 

Multi-Aircraft Control System 

MIPR 

Military Interdepartmental Purchase Request 

MIT/LL 

Massachusetts Institute of Technology Lincoln Labs 

MOA 

Memorandum of Agreement/Methods of Assessment 

MOCC 

Mobile Operations Control Center 

MOE 

Meeting of Experts 

MOPS 

Minimum Operational Performance Standard 

MR 

Measured Response 

MRB 

Management Review Board 

MS&A 

Modeling, Simulation, and Analysis 

MUSIM 

Multiple UAS Simulation 

NAS 

National Airspace System 

NATO 

North Atlantic Treaty Organization 

NRA 

NASA Research Announcement 

NUANCE 

Nevada Unmanned, Autonomous, and NextGen Collaborative Environment 

OCFO 

Office of the Chief Financial Officer 

OPNET 

OPNET Technologies 

OSD 

Office of the Secretary of Defense 

PI 

Phase 1 

P2 

Phase 2 

PDR 

Preliminary Design Review 

PE/Co-PE 

Project Engineer/Co-Project Engineer 

PI 

Progress Indicator 

PM 

Program Manager or Project Manager 

PMT 

Project Management Tool 


Acronym List 



PO 

Project Office 

PPBE 

Planning Programming Budgeting and Execution 

PRD 

Project Requirements Document 

PRP 

Performance Review Panel 

PT 

Part Task Simulation 

R&D 

Research and Development 

RA 

Resolution Advisory 

RFI 

Request for Information 

RFP 

Request for Proposal 

RGCS 

Research GCS 

SA 

Situational Awareness/Separation Assurance 

SAA 

Sense and Avoid/Space Act Agreement 

SARP 

Science and Research Panel 

SASO 

Safe, Autonomous Systems Operations 

SBIR 

Small Business Innovative Research 

SC 

Special Committee 

SE 

Systems Engineering 

SMART NAS 

Shadow Mode Assessment using Realistic Technologies for the National Airspace System 

SME 

Subject Matter Expert 

SMP 

Schedule Management Plan 

SP 

Schedule Package 

SRR 

System Requirements Review 

SS 

Self-Separation 

SSG 

Senior Steering Group 

SSI 

Separation Assurance/Sense and Avoid Interoperability Subproject 
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Acronym List 


SST 

Self-Separation Threshold 

SSV 

Self-Separation Volume 

SUA 

Special Use Airspace 

sUAS 

small Unmanned Aircraft System 

SWAP 

Size Weight And Power 

TASATS 

Traffic Advisory and Safety Alerting Threshold Simulation 

TC 

Technical Challenges 

TCAS 

Traffic Alert and Collision Avoidance System 

ToR 

Terms of Reference 

TPWG 

Test Plan Working Group 

TRACON 

Terminal Radar Approach Control Facilities 

TWP 

Technical Work Package 

UA 

Unmanned Aircraft 

UAS 

Unmanned Aircraft Systems 

UAV 

Unmanned Aircraft Vehicle 

UTM 

UAS Traffic Management 

V&V 

Verification and Validation 

VFR 

Visual Flight Rules 

VSCS 

Vigilant Spirit Control Station 

WBS 

Work Breakdown Structure 

WG 

Working Group 

WJHTC 

William J Hughes Technical Center 

WRC 

World Radio Conference 

WYE 

Work Year Equivalent 



UAS Integration in the NAS Project 



Goal: Provide research findings to reduce technical barriers associated with 
integrating Unmanned Aircraft Systems (UAS) into the National Airspace System 
(NAS) utilizing integrated system level tests in a relevant environment 


• Developed algorithms to assist 



UAS pilots to remain well clear 


fee- 

of traffic. 


M. 


Sense and Avoid (SAA) 
Performance 

Standards 


assess algorithm performance. 


Developed Control Non-Payloac 
Communications (CNPC) system 
for C2 and voice 
communications. 


Command and Control 
(C2) Performance 

Standards 


Use simulation, ground and 
flight test to assess CNPC 
performance. 



Human Systems 
Integration (HSI) 


Developed prototype ground 
control station (GCS) and 
displays to examine human 
factors components of SAA & 
C2. 



Use simulation and flight test 
to develop GCS guidelines. 


Integrated 

Test & Evaluation (IT&E) 


Developed Live Virtual 
Constructive (LVC) test 
environment 

Execute relevant environment 
testing to gather SAA, C2, and 


HSI research data. 


RTCA 



DAA 

RTCA 1 

MOPS 


C2 

1 1 

1 

OPS 


RTCA SC-228 developing Minimum Operational Performance Standards (MOPS). 
Expected release in summer 2016. Project research supports MOPS development 

DAA: MOPS for transitioning of a UAS to and from Class A or special use airspace, 
traversing Class D and E, and perhaps Class G airspace. 

C2: MOPS for C2 Data Link using L-Band Terrestrial and C-Band Terrestrial data links 





